Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter.
Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.
OCR for page 115
APPENDIX E
Effectiveness Metrics
Table 29 summarizes the effectiveness metrics for each best practice.
Table 29. Effectiveness metrics by best practice.
Practices Relevant Metrics
Screening and Selecting Employees
Effective candidate screening. % of candidates screened
Training and Testing
Effective training preparation Yes/No:
Include staff in design and development of training
program
Train the trainer
Prepare trainees for rules training by explaining
expectations
Information transfer methods Pre/Post tests that evaluate understanding purpose of
rules
% rules with explanations
Action-based rules training Pre/Post tests that evaluate understanding how rule is
applied
% rules with examples
% rules with practice opportunities
Annual opportunities for refresher training
% scheduled refresher training completed
% of action-based training that incorporates positive
feedback during training
Course evaluation containing question about frequency
and quality of feedback during training
Crew resource management Number of teams trained
Assessing effectiveness of rules training % training programs that measure training effectiveness
Is there a post test for all rules training? (Likert scale
that evaluates effectiveness for multiple dimensions)
Communication
Proactive rules communication % of crew reporting locations with bulletin boards or
variable message signs
% rule changes posted
Opportunities to ask questions Number of safety meetings or other discussion
opportunities
Communicating changes to rules % employees participated in "meet and greet"
% employees who acknowledge receipt of new rule in
writing
Positive safety language number or % of safety communications containing
nonthreatening safety language
Customer feedback number of reports regarding operator behavior
average follow-up time
(continued on next page)
115
OCR for page 116
116 Improving Safety-Related Rules Compliance in the Public Transportation Industry
Table 29. (Continued).
Practices Relevant Metrics
Monitoring Rules Compliance
Operational testing number and types of tests
% passing
number of major rule violations
Observational methods number and types of observations
% and number in compliance with rules
number of safety audits
number and types of problems observed and coached
Automated methods % and number in compliance with rules
Responding to Noncompliance
Noncompliance investigative process number or % of noncompliance incidents investigated
number or % of incidents where root cause analysis was
applied
Handling noncompliance % and number of discipline cases
% and number of dismissals
% and number coaching cases
% and number of remedial training cases
Safety Management
Assessing the rules compliance program Outcome will be the application of the metrics in this table to
the agency's rules compliance practices.
Encouraging employee involvement number of management/labor committees
number of posters/notices inviting employees to express
concerns
Reporting near-misses and other safety number of reports per month
risks average time to respond to reporting employee
number of recommendations implemented
Incentivizing rules compliance number of awards per 100 employees (or some other
number)
