Internet Learning Series Presentation

iLS Training Evaluation:  iLS Training Evaluation Shani Robins, Ph.D. Organizational Consulting Center California School of Professional Psychology Alliant International University [email protected] Background Information:  Background Information The iLS questionnaire was sent via email to 252 Cadence employees who enrolled during Q2 2000 through Q4 2001 Pre-Sales AE Methodology Services Customer Support A week following distribution of questionnaire, each individual was personally contacted via phone as a reminder to submit 62 questionnaires were returned 15 employees did not complete or take an iLS course Reasons no time A live class became available Signed up for an alternate person (customer/co-worker) The course expired before they could complete it Technology & Roles Within Cadence:  Technology & Roles Within Cadence Total Roles Technology Roles Within Specific Technology:  Roles Within Specific Technology Motivation:  Motivation Conclusion: Acquiring Knowledge is the Biggest Motivator iLS Classes Taken Internally:  iLS Classes Taken Internally How Are Employees Connecting:  How Are Employees Connecting Internet Connection Office Location Platform Quotes From the Employees :  Quotes From the Employees “The notes were for the most part ok but I did find that sometimes the material was a bit outdated even with respect to the labs and such. Also, I submitted a question once and was never answered. I think the pace of the course was good and the material relevant. The quizzes helped me remember the material so they were good.” “The voice-over add little or nothing to the topic but do take quite a while to download. This course does nothing to take advantage of the web – it’s just the book copied on the web.” “I am hearing from IBM that the iLS classes are good as far as showing you what buttons to press and tool features, but need more methodology training on how to use the tools in a real life situation.” “I have feedback from the customer where a couple of people have taken the iLS training and it is an excellent training concept which has suited there needs” Structure & Quality Scale Rating:  Structure & Quality Scale Rating 1=Strongly Disagree, 2=Somewhat Disagree, 3=Neutral, 4=Somewhat Agree, 5=Strongly Agree Scale Mean = 3.85 Satisfaction Scale Rating:  Satisfaction Scale Rating 1=Strongly Disagree, 2=Somewhat Disagree, 3=Neutral, 4=Somewhat Agree, 5=Strongly Agree Scale Mean = 3.63 Knowledge Scale Rating:  Knowledge Scale Rating Scale Mean = 3.63 Usability Scale Rating:  Usability Scale Rating 1=Strongly Disagree, 2=Somewhat Disagree, 3=Neutral, 4=Somewhat Agree, 5=Strongly Agree Scale Mean = 3.74 Age Distribution:  Age Distribution Conclusion: Age Did Not Make a Difference in Rating Educational Degree Distribution:  Educational Degree Distribution Conclusion: Increased Education Enables Greater Understanding Years of Experience Distribution:  Years of Experience Distribution Years of Experience in Engineering Field Years of Experience in Course Field Aptitude X Treatment Interaction:  Aptitude X Treatment Interaction Snow & Lohman (1984) English First Language:  English First Language Languages Requested: Italian, Hindi, Dutch, French Conclusion: Decrease in facility with English leads to higher ratings Overall Conclusions:  Overall Conclusions The ILS classes are good, with room for improvement People with more education and experience are better able to bring expertise to bear wherever classes are lacking People with moderate education and experience need additional resources & support within the class structure Quizzes Interactive Exercises Additional Reading Materials Tailored Feedback to Learners Level of Expertise