Online Class Evaluations 8

Information about Online Class Evaluations 8

Published on October 30, 2007

Author: Belly

Source: authorstream.com

Content

Please silence cell phones.:  Please silence cell phones. THANK YOU! Slide2:  Challenges and Advantages of Online Class Evaluations Shohreh Bozorgmehri Manager, Instructional Web Technologies & Briandy Walden Web Developer, Instructional Web Technologies TOPICS:  TOPICS BACKGROUND CHALLENGES TRANSITION ADVANTAGES & RESULTS FACTS & FIGURES FUTURE CONCLUSION QUESTIONS BACKGROUND:  BACKGROUND Paper Online Version 1: Instructor-initiated Version 2: Department Administrative Tool for Evaluations (D.A.T.E.) Inspiration BACKGROUND:  BACKGROUND Paper Process Purchase Scantron forms Organize & distribute packets Fill in forms Collect & return forms Scan forms Analyze results Distribute results to instructors BACKGROUND:  BACKGROUND Academic Senate Role EEE final evaluations are based on the Campus-wide Teaching Evaluation Form (CTEF) approved by the academic senate committee, the Council on Student Experience (CSE). Senate proposal: http://www.senate.uci.edu/9_IrvineManual/3ASMAppendices/Appendix11.html http://www.senate.uci.edu/9_IrvineManual/3ASMAppendices/Appendix11App2.html BACKGROUND:  BACKGROUND Instructor initiated Campus-wide Teaching Evaluation Form (CTEF) Secure and anonymous Fixed one time email announcement Automated analysis of results First Online Evaluations BACKGROUND:  BACKGROUND Online evaluations had initially been driven by faculty requests. With broader interest, the needs of entire Schools or Departments became the new driving force behind the direction of the online evaluation tool’s evolution. BACKGROUND:  BACKGROUND Engineering was the first school to use EEE’s tool school-wide Entire school switched to online Final Evaluations Simple Administrative Web page was developed School’s evaluations fully online by Fall 2003 Learned from experience and incorporated feedback into version 2 CHALLENGES:  CHALLENGES Significant Culture change Concern of response rate decrease Students would become responsible for taking and submitting evaluations on own time and outside of class Duration changed from 15 minutes inside the classroom to what individual students chose on their own Instructors would need to diligently notify and remind students in order to receive desirable submissions Departments would need to communicate to faculty and/or directly enrolled students ENCOURAGEMENT & COMMUNICATION BECAME VITAL CHALLENGES:  CHALLENGES Evaluation requirements: CTEF format Anonymity Department Customizability Cooperation from academic units Willingness to take part in a potentially difficult transition Strong history of good support and cooperation helped convince Departments that their needs would be met, and any unexpected issues would be addressed Instructor & Student participation Notification of students encouragement to participate required for best results TRANSITION PROCESS OVERVIEW:  TRANSITION PROCESS OVERVIEW TOOL FEATURES ACTIVATION ANNOUNCEMENT MONITORING RESULTS WEB INTERFACE STUDENT EXPERIENCE TRANSITION:  TRANSITION Tool Features Departments steered development with requests: Optional addition of four custom questions Scantron-like results file Printable report with page breaks Response rate monitoring tools More department control over instructor options Email reminders for multiple evaluations combined into one Only non-respondents receive reminders TRANSITION:  TRANSITION Activation Administrators Create and upload CSV files containing instructor IDs and course codes Specify the bounds of instructor control over evaluation windows TRANSITION:  TRANSITION Announcement Administrators compose, schedule, and send email announcements and/or reminders using a simple online form through the Web interface No limit to the number of announcements sent Only non-respondents do receive reminders Reminder emails can have different subject-line or body each time TRANSITION:  TRANSITION Monitoring Administrators monitor rate of evaluation submissions Constant monitoring helps department administrators decide when to send announcements or reminder emails TRANSITION:  TRANSITION Results Speed: Administrators, evaluated instructors, and teaching assistants view and download results files in desired format(s) after the “Registrar’s Final Grade Submission Deadline”. Flexible Formats: Comma Separated Value (CSV) Print-friendly report Scantron compatible TRANSITION:  TRANSITION Error check Prevents user errors from adversely affecting the process Instructor abilities Preserves option to allow or disallow instructors from changing evaluation dates/times, or canceling evaluations Retains midterm evaluation options for all instructors, regardless of Department-activated final evaluations The D.A.T.E. Web Interface makes Department activation of final evaluations for multiple instructors easy and efficient. TRANSITION:  TRANSITION Online form Requires secure authentication Available anywhere, at any time during the evaluation window Quick and easy multiple choice questions Provides space for typed open-ended responses Incentives “Respondent List” makes incentives possible Anonymity preserved Names cannot be associated with responses List only available if 5 or more responses received (minimum increasable at department discretion) ADVANTAGES & RESULTS:  ADVANTAGES & RESULTS Save Time: 90% savings common Save Money: $2000/yr for Scantron (PhySci) Add Customizability: Add 4 custom questions Unexpected side-effect: With online evaluations, students have begun to submit more thorough and detailed comments, presumably because they are under no time pressure, and are able to type, rather than handwrite, their comments. Because comments are already typed, they can be distributed and read more easily and quickly. Results are compiled and ready for distribution and review in matter of hours rather than months. Faculty are enabled to powerfully and immediately reflect the evaluation results to the upcoming class. Some departments more rapidly are able to renew or take away TAs or lecturers appointments. DEFINITE IMPACT ON QUALITY OF TEACHING ADVANTAGES & RESULTS:  ADVANTAGES & RESULTS EEE’s Evaluations tool is the fastest growing tool in the EEE course management system toolbox FACTS & FIGURES:  FACTS & FIGURES 1 2 3 4 5 SurveyMonkey QuestBack Zoomerang Paper Evaluations D.A.T.E. Supported Unsupported FACTS & FIGURES:  FACTS & FIGURES FACTS & FIGURES:  FACTS & FIGURES Submissions Classes Engineering Physical Sciences Biological Sciences FACTS & FIGURES:  FACTS & FIGURES * Projected Department participation for Fall, 2005 FACTS & FIGURES:  FACTS & FIGURES * Numbers in parentheses represent percentage of time saved per department FUTURE:  FUTURE More customizability New survey engine will power tools: Evaluation tool Survey tool Quiz tool More mobility Ability to share Evaluation forms with others Re-use frequently used questions & answers CONCLUSION:  CONCLUSION D.A.T.E.’s strength and key success come from the solid partnership our team has created and maintained with a wide range of senior academic faculty, committees, and campus units. QUESTIONS?:  QUESTIONS? For questions, please contact: http://eee.uci.edu/iwt/uccsc2005/ or [email protected]

Related presentations


Other presentations created by Belly

Capital budgeting
28. 04. 2008
0 views

Capital budgeting

Nice pics slides
17. 09. 2007
0 views

Nice pics slides

perceptron 2 4 2008
30. 04. 2008
0 views

perceptron 2 4 2008

pham07
18. 04. 2008
0 views

pham07

FC STONE GREAT WALL1
17. 04. 2008
0 views

FC STONE GREAT WALL1

Sauter Nuts Bolt ETFs
16. 04. 2008
0 views

Sauter Nuts Bolt ETFs

UnivOfGuelphNov26th
14. 04. 2008
0 views

UnivOfGuelphNov26th

fujiwara
13. 04. 2008
0 views

fujiwara

Week 08 Finance
10. 04. 2008
0 views

Week 08 Finance

Lct1
09. 04. 2008
0 views

Lct1

outlook
19. 06. 2007
0 views

outlook

Microsoft Windows Vista
19. 06. 2007
0 views

Microsoft Windows Vista

2004 presentation
13. 09. 2007
0 views

2004 presentation

Australian
13. 09. 2007
0 views

Australian

NBB
13. 09. 2007
0 views

NBB

Thilo Ewald ppt
13. 09. 2007
0 views

Thilo Ewald ppt

20031216 NASANIH presentation
05. 10. 2007
0 views

20031216 NASANIH presentation

mna presentation
17. 10. 2007
0 views

mna presentation

lect29 groupwords
18. 10. 2007
0 views

lect29 groupwords

Essential Q Imperialism 2
22. 10. 2007
0 views

Essential Q Imperialism 2

p puska
07. 09. 2007
0 views

p puska

Productivity
07. 09. 2007
0 views

Productivity

honeyPots
13. 09. 2007
0 views

honeyPots

NDB Bensouda
23. 10. 2007
0 views

NDB Bensouda

181105
24. 10. 2007
0 views

181105

METO200Lect19 20
05. 10. 2007
0 views

METO200Lect19 20

oksupercompsymp2006 talk matrow
17. 10. 2007
0 views

oksupercompsymp2006 talk matrow

mareyes
25. 10. 2007
0 views

mareyes

2 01 3
29. 10. 2007
0 views

2 01 3

1 3Grand father Journey
02. 11. 2007
0 views

1 3Grand father Journey

TuijaKuisma
07. 09. 2007
0 views

TuijaKuisma

Metallsektor
14. 11. 2007
0 views

Metallsektor

insects in out
13. 09. 2007
0 views

insects in out

oasen
16. 11. 2007
0 views

oasen

Unit 10 Scent Theory
17. 11. 2007
0 views

Unit 10 Scent Theory

SPEAR 2004
21. 11. 2007
0 views

SPEAR 2004

danse macabre
22. 11. 2007
0 views

danse macabre

kmutt
13. 09. 2007
0 views

kmutt

NCUR SDT 4 19 05
04. 01. 2008
0 views

NCUR SDT 4 19 05

gerber colloq UICtop feb2002
15. 10. 2007
0 views

gerber colloq UICtop feb2002

Lioi Altered Version
07. 01. 2008
0 views

Lioi Altered Version

Five Halloween Pumpkins audacity
02. 11. 2007
0 views

Five Halloween Pumpkins audacity

smime
07. 10. 2007
0 views

smime

CdF BEC
20. 11. 2007
0 views

CdF BEC

WEB C Schumacher
23. 10. 2007
0 views

WEB C Schumacher

bsb
13. 09. 2007
0 views

bsb

2006052213550876705
03. 01. 2008
0 views

2006052213550876705

1 11
19. 02. 2008
0 views

1 11

Ukraine
20. 02. 2008
0 views

Ukraine

truck tmp1002
27. 02. 2008
0 views

truck tmp1002

ace program plan
29. 02. 2008
0 views

ace program plan

takala
07. 09. 2007
0 views

takala

464 TM12
14. 12. 2007
0 views

464 TM12

ICEBP presentation for ANZCP A
10. 03. 2008
0 views

ICEBP presentation for ANZCP A

aionescu cmc dec06
30. 10. 2007
0 views

aionescu cmc dec06

creationtalk
11. 03. 2008
0 views

creationtalk

Data Mining 2
12. 03. 2008
0 views

Data Mining 2

Omaha Pres for NAP web2
29. 12. 2007
0 views

Omaha Pres for NAP web2

sustainable development part1
26. 03. 2008
0 views

sustainable development part1

Schrage
31. 08. 2007
0 views

Schrage

IHYJP Kickoff Poster
09. 10. 2007
0 views

IHYJP Kickoff Poster

020703 DHCAL
31. 08. 2007
0 views

020703 DHCAL

Vimpel Com
31. 08. 2007
0 views

Vimpel Com

Overland vista uib itforum
19. 06. 2007
0 views

Overland vista uib itforum

OS Notes
19. 06. 2007
0 views

OS Notes

NVIDIA OpenGL on Vista
19. 06. 2007
0 views

NVIDIA OpenGL on Vista

NonAdmin Pilot
19. 06. 2007
0 views

NonAdmin Pilot

New Mexico NETUG WPF
19. 06. 2007
0 views

New Mexico NETUG WPF

nercomp SIG
19. 06. 2007
0 views

nercomp SIG

MSAM Launch Vista Final Updated
19. 06. 2007
0 views

MSAM Launch Vista Final Updated

MOSS WF Talk
19. 06. 2007
0 views

MOSS WF Talk

More Online Games
19. 06. 2007
0 views

More Online Games

MHay Wireless
19. 06. 2007
0 views

MHay Wireless

Marl WSUS3
19. 06. 2007
0 views

Marl WSUS3

mail list news
19. 06. 2007
0 views

mail list news

Lenovo UofU
19. 06. 2007
0 views

Lenovo UofU

Lecture II
19. 06. 2007
0 views

Lecture II

Smith F09
13. 10. 2007
0 views

Smith F09

35508
26. 02. 2008
0 views

35508

pinar
19. 06. 2007
0 views

pinar

pgp
19. 06. 2007
0 views

pgp

pessner
19. 06. 2007
0 views

pessner

Overview Presentation
19. 06. 2007
0 views

Overview Presentation

North Dakota Annuity Deck
19. 06. 2007
0 views

North Dakota Annuity Deck

Rutland Presentation plenary4
31. 08. 2007
0 views

Rutland Presentation plenary4

NAMI NC 112707
07. 01. 2008
0 views

NAMI NC 112707

finland poster
07. 09. 2007
0 views

finland poster

sample
27. 09. 2007
0 views

sample

dtk
13. 09. 2007
0 views

dtk

Phenotyping Oxford
17. 10. 2007
0 views

Phenotyping Oxford

dog breeding
19. 11. 2007
0 views

dog breeding

5th trondhiem
29. 11. 2007
0 views

5th trondhiem

policies regs
28. 12. 2007
0 views

policies regs

GetuHailu
13. 09. 2007
0 views

GetuHailu

genealogy
01. 10. 2007
0 views

genealogy

net info 050928
19. 06. 2007
0 views

net info 050928

chap7
15. 10. 2007
0 views

chap7

Rafael Guillen CCAD SIAM mar06
22. 10. 2007
0 views

Rafael Guillen CCAD SIAM mar06

na3 Russia
31. 08. 2007
0 views

na3 Russia

Sois Global Programs3 12 04
31. 08. 2007
0 views

Sois Global Programs3 12 04

sacha
31. 08. 2007
0 views

sacha

amm pres valdez lacnic
22. 10. 2007
0 views

amm pres valdez lacnic

nwnt
19. 06. 2007
0 views

nwnt

STAR shielding 2
13. 11. 2007
0 views

STAR shielding 2

voiceline overview
17. 10. 2007
0 views

voiceline overview

gross PPT
07. 04. 2008
0 views

gross PPT

WP1a
15. 10. 2007
0 views

WP1a

Microarray Data Standard
07. 11. 2007
0 views

Microarray Data Standard

Lim Badejo Dell Presentation 1
19. 06. 2007
0 views

Lim Badejo Dell Presentation 1

HongKong Punkka Salo
07. 09. 2007
0 views

HongKong Punkka Salo

Dvoretsky
31. 08. 2007
0 views

Dvoretsky

qm1 web
03. 01. 2008
0 views

qm1 web

IAPS
07. 09. 2007
0 views

IAPS

yalestudy
28. 09. 2007
0 views

yalestudy

digvlsideslec1
12. 10. 2007
0 views

digvlsideslec1

mead
13. 09. 2007
0 views

mead

bashmakov
31. 08. 2007
0 views

bashmakov