Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
93 A P P E N D I X F Level 1 Training Evaluation Tool Pre- and Post-Training Course Evaluations Successful training organizations utilize metrics to assess the difference in the quality of work after an employee has completed a training. The presence of baseline evaluation metrics is an important factor in identifying the effects of the training and whether the program has demonstrated intended results. Evaluation questions should reflect the learning objectives of the course and are the source for the pre- and post-test instruments. These questions reflect what is ultimately being tested in the evaluation. Once training is complete, organizations use the same pre-training evaluation questions and methods to collect comparison data. For example, before training begins, practitioners select a data collection technique that will test participants to determine their baseline knowledge, skills, and attitudes. Once training is complete, employees are tested a second time to measure what they have learned. Ideally, the pre-test and post-test occur shortly before and after training commencement and completion to more confidently align changes to the training, though this varies depending on the change or measure sought. Pre-Training Evaluation Instructions Thank you for completing this survey aimed at assessing the effectiveness of the [insert course name]. Before completing [insert course name], we request your participation in a survey to assess the effectiveness of the training by analyzing your responses pre- and post-course. Your participation is critical, so please complete the survey between now and [insert survey response deadline date].
94 Transit Technical Training, Volume 2: Guide to Overcoming Barriers to Implementing Best and Innovative Training 6. Please select the rating that best describes your confidence performing the following activities on the job: Not at all Confident Not Confident Neutral Confident Very Confident Not Applicable Course Objective 1 Course Objective 2 Course Objective 3 Course Objective 4 Course Objective 5 7. How do you anticipate using the knowledge and skills you gain from this course? ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ 1. Why are you taking this course? a. I want to start a new job in this field. b. I want to advance my career in this field. c. I am being mandated to take it. d. I am taking this as a refresher course. e. Other______________ Please select the rating that best describes how much you agree with the following statements: Strongly Disagree Disagree Neutral Agree Strongly Agree 2. It is an appropriate time in my career to take this course. 3. The course will assist me in furthering my career in this field. 4. I understand the objectives of this course. 5. I understand the prerequisites and/or pre-course materials for the course.
Level 1 Training Evaluation Tool 95 Post-Training Course Evaluation Instructions Thank you for completing this survey aimed at assessing the effectiveness of the [insert course name]. You recently completed the [insert course name]. We request your participation in a survey to assess the effectiveness of the training. Your participation is critical, so please complete the survey between now and [insert survey response deadline date]. Please select the rating that best describes how much you agree with the following statements: Overall Course Strongly Disagree Disagree Neutral Agree Strongly Agree 1. The course met my expectations. 2. The course occurred at an appropriate time in my career. 3. I intend to use what I learned in this course on the job. 4. The course will assist me in furthering my career. 5. Overall, I was satisfied with the course. Course Content Strongly Disagree Disagree Neutral Agree Strongly Agree 6. The course content was comprehensive. 7. All course objectives were covered during the course. 8. The course materials were easy to follow and use. 9. The course materials facilitated my achievement of the course objectives. 10. The way this course was delivered [such as discussion/small group exercises or (for CBT) self- paced method] is an effective way for me to learn this content.
96 Transit Technical Training, Volume 2: Guide to Overcoming Barriers to Implementing Best and Innovative Training 11. What, if anything, would you change in this course? (Select all that apply.) Make the course longer Make the course shorter Reduce the pace of instruction Increase the pace of instruction Reduce the level of complexity Increase the level of complexity More exercises Fewer exercises No exercises More discussion Less discussion No discussion 12. Please select the rating that best describes your confidence performing the following on the job: Not at all Confident Not Confident Neutral Confident Very Confident Not Applicable Course Objective 1 Course Objective 2 Course Objective 3 Course Objective 4 Course Objective 5 13. What changes do you plan to make on the job using the knowledge you gained from this course? ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ 14. What did you like the most about this course? ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ 15. What did you like the least about this course? ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________
Level 1 Training Evaluation Tool 97 ____________________________________________________________________________ ____________________________________________________________________________ 17. Would you recommend this course to others? Yes No Thank you again for your time and participation! 16. How could this course be improved? ____________________________________________________________________________ ____________________________________________________________________________
98 Transit Technical Training, Volume 2: Guide to Overcoming Barriers to Implementing Best and Innovative Training Post-Training Instructor Evaluation Feedback for instructors is an important component of continually improving training and better achieving training impact goals. The instructors themselves should be considered an element of the training design that will also contribute to its effectiveness. Gathering instructor feedback from participants is one of the effective ways to evaluate an instructor, assess instructor capabilities, and identify areas of improvement. Organizations should engage with the instructor to appraise results by asking questions such as What associations or alignments can be made between the instructor evaluation and overall training evaluation? What specific changes should be made to training design or content? What specific changes should be made to training delivery? The below assessment is an example that can be used to collect instructor feedback from participants after the completion of a training. Instructions Thank you for completing this survey aimed at assessing the effectiveness of the [insert course name]. You recently completed the [insert course name]. We request your participation in a survey to assess the effectiveness of the instructor of this course. Your participation is critical, so please complete the survey between now and [insert survey response deadline date]. Please select the rating that best describes how much you agree with the following statements: Strongly Disagree Disagree Neutral Agree Strongly Agree 1. The instructor set clear goals and expectations of the course. 2. The instructor was knowledgeable on the course content. 3. The instructor provided relevant examples when explaining the course content. 4. The instructor presented the material at an appropriate pace. 5. The instructor used effective strategies/techniques to present the course material.
Level 1 Training Evaluation Tool 99 Strongly Disagree Disagree Neutral Agree Strongly Agree 8. I would recommend this instructor to others. 9. Please provide an overall rating for the instructor of the course with âAâ being the best and âFâ being the lowest score. A B C D F 10. What did you like the most about how the course was instructed? ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ 11. What did you like the least about how the course was instructed? ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ 12. Please note any recommendations for changes to the instruction of this course. ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ 6. The instructor answered questions. 7. The instructor was available for extra help.
