TRB Special Report 309: Evaluating the Effectiveness of Offshore Safety and Environmental Management Systems (2012) / Chapter Skim
Currently Skimming:
3 Methods for Assessing Effectiveness
3 Methods for Assessing Effectiveness
Pages 52-62
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 52... ...
SEMS regulations prescribe specific audit requirements: a comprehensive audit 2 years from the initial implementation of the SEMS program and at least once every 3 years thereafter. Potential assessment methods The breadth and depth of SEMS require that several methods be used to assess its effectiveness on an ongoing basis for continuous improvement in development and implementation.
|
From page 53... ...
Table 3-1 summarizes the nine methods, which are discussed below, and notes pros and cons for each one. Compliance inspections Compliance inspection is one of the simplest forms of SEMS verification.
|
From page 54... ...
Checklist Checklist to ensure SEMS is Simple to implement with May only assess compliance in place on platform minimal training with paperwork or system; Checklist scope and details May quickly identify limited assessment of may vary deficiencies with effectiveness of the SEMS SEMS program and program implementation Platform specific; not a corporate wide check Content and quality can vary extensively Must develop checklists b. Interviews, witnessing, Interviews or other communica- Can provide information Can be subjective California State Lands and so forth tion with platform personnel to assess whether Reliant on interviewer skills Commission program to determine whether they platform personnel Additional SEMS training is an example understand the SEMS program, are knowledgeable required, perhaps substantial including possible test drills and use SEMS Time consuming May be concurrent with administering checklists
|
From page 55... ...
Event-driven audit Triggered by events such as injury Immediately corrects SEMS Reactive, lagging assessment May be required in any or death, pollution, a near issues, if applicable May not reflect processes in case by regulations miss, and noncompliance place prior to incident 3. Peer review, peer assist Assessment of SEMS implemen- Team is qualified and Independence may be questioned tation by a team composed of experienced in SEMS Potential conflicts of interest and peers from the industry Nonthreatening identifica- confidentiality tion of catastrophic Potential legal liability issues weaknesses and related to discoverability of opportunities to improve recommendations and recom Good potential to learn mendations given in good faith from each others' SEMS that have poor outcomes (continued on next page)
|
From page 56... ...
Key performance indicators Use metrics from corporate- or Easy to implement relate to SEMS effectiveness specific SEMS INCs platform-specific data to Can be automated and New metrics may need to be assess SEMS effectiveness reported to BSEE developed Metrics can be currently reported regularly (quarterly) If metrics do not accurately ones (e.g., INCs, spills, reflect safe conditions, they accidents, near misses)
|
From page 57... ...
Monitoring sensors Tracking onboard sensors to Quantitative SEMS Need to identify how these establish specific metrics for measure sensors may reflect SEMS SEMS purposes Possible future development issues of SEMS-specific sensors Can send data back to shore for evaluation 9. Calculation of risk with Specific quantitative methods Measurable Quantitative, results can vary SEMS in place (QRA)
|
From page 58... ...
Peer Review and Peer assist Often simply referred to as "peer assist," this method of assessing effectiveness engages several respected industry peers from outside the organization, including other operators, in reviewing the company's compliance performance and SEMS implementation. The reviewers then suggest helpful ideas for improvement.
|
From page 59... ...
This method is based on the premise of promoting a "don't blame, let's improve" culture. The aviation industry is one in which the peer assist approach is employed.1 Key Performance indicators Key performance indicators (KPIs)
|
From page 60... ...
Many industries use whistleblower programs, so there are many examples that can be used in conjunction with SEMS programs. Periodic lessee Reports Operators or lessees may generate periodic reports describing the effectiveness of their SEMS program.
|
From page 61... ...
measuRing tRends The methods identified above directly assess the effectiveness of specific operator SEMS programs. However BSEE could aggregate the data across operators to monitor the trends and provide input to operators on specific improvements or areas of concern.
|
From page 62... ...
Operating management, from first-line supervisors to top management, might find it useful to assess their progress toward improvement of safety and environmental conditions on an ongoing basis with a combination of SEMS monitoring sensors, KPIs, records of potential incidents of noncompliance, interviews, and other methods. Periodic assessment with drills, peer reviews, and lessee SEMS reports might have a broader scope than operational aspects and operating management.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.