Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.
OCR for page 115
APPENDIX E Effectiveness Metrics Table 29 summarizes the effectiveness metrics for each best practice. Table 29. Effectiveness metrics by best practice. Practices Relevant Metrics Screening and Selecting Employees Effective candidate screening. % of candidates screened Training and Testing Effective training preparation Yes/No: Include staff in design and development of training program Train the trainer Prepare trainees for rules training by explaining expectations Information transfer methods Pre/Post tests that evaluate understanding purpose of rules % rules with explanations Action-based rules training Pre/Post tests that evaluate understanding how rule is applied % rules with examples % rules with practice opportunities Annual opportunities for refresher training % scheduled refresher training completed % of action-based training that incorporates positive feedback during training Course evaluation containing question about frequency and quality of feedback during training Crew resource management Number of teams trained Assessing effectiveness of rules training % training programs that measure training effectiveness Is there a post test for all rules training? (Likert scale that evaluates effectiveness for multiple dimensions) Communication Proactive rules communication % of crew reporting locations with bulletin boards or variable message signs % rule changes posted Opportunities to ask questions Number of safety meetings or other discussion opportunities Communicating changes to rules % employees participated in "meet and greet" % employees who acknowledge receipt of new rule in writing Positive safety language number or % of safety communications containing nonthreatening safety language Customer feedback number of reports regarding operator behavior average follow-up time (continued on next page) 115
OCR for page 115
116 Improving Safety-Related Rules Compliance in the Public Transportation Industry Table 29. (Continued). Practices Relevant Metrics Monitoring Rules Compliance Operational testing number and types of tests % passing number of major rule violations Observational methods number and types of observations % and number in compliance with rules number of safety audits number and types of problems observed and coached Automated methods % and number in compliance with rules Responding to Noncompliance Noncompliance investigative process number or % of noncompliance incidents investigated number or % of incidents where root cause analysis was applied Handling noncompliance % and number of discipline cases % and number of dismissals % and number coaching cases % and number of remedial training cases Safety Management Assessing the rules compliance program Outcome will be the application of the metrics in this table to the agency's rules compliance practices. Encouraging employee involvement number of management/labor committees number of posters/notices inviting employees to express concerns Reporting near-misses and other safety number of reports per month risks average time to respond to reporting employee number of recommendations implemented Incentivizing rules compliance number of awards per 100 employees (or some other number)