Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
45 Conclusions The research team believes it has established that a full, four- level Kirkpatrick Model evaluation methodology is applicable and implementable for a nationwide rollout of the Interdisci- plinary TIM Training Curriculum. The research affirms the feasibility and practicality of implementing a TIM assessment tool that meets the requirements set forth in the original proj- ect RFP, using readily available, cost-effective technology. While Level 3 and Level 4 measures of training effective- ness are widely viewed as the most valuable, most organiza- tions are not able to attain them. The effectiveness of any training program can only be measured over time and with many inputs. Doing this requires a sustained organizational commitment to an assessment process. The TIM assessment tool, which is the product of this research project, is a means to that end but not an end in and of itself. The successful imple- mentation of a TIM assessment program requires clear busi- ness ownership, leadership, committed staffing, and other resources. Recommendations The TIM assessment tool represents not only a new application to be supported but also a new functional area within the TIM program. The initial business model developed early in this research might serve as a useful framework to assess staffing and other resources required to implement a TIM assessment program. When a sponsoring agency takes ownership of the TIM assessment tool, high-level goals to consider include matur- ing the L32C application, generating more interest from the user community, and building up program support around the measurement of training effectiveness. The following are suggestions for possible work that the sponsoring agency could undertake. Use L32C Product for Ongoing TIM Training Activities The sponsoring agency might use the TIM assessment tool to support ongoing training activities, including workshops, train-the-trainer and other classroom training events, and planned online courses. Staff support will be needed to collect information and Level 1 and 2 surveys from attendees and, in the case of online training, import similar information from NHI. Staff support will also be required to implement subse- quent Level 3 and 4 assessments and to produce reports and analyses that provide insights to the TIM program. The sponsoring agency will need to continue hosting and administering the TIM assessment tool. That will mean ⢠Monitoring system health and usage and taking remedial actions whenever necessary to maintain adequate service levels; ⢠Performing tasks such as granting/revoking user access privileges and installing patches and updates in the produc- tion environment; and ⢠Providing customer support and identifying, document- ing, and addressing system defects. Enhance Functions and Processes As the tool is used more broadly, user feedback and sugges- tions will likely be received. This input should be periodically reviewed, analyzed, and prioritized to identify issues that should be addressed. A structured mechanism to track, respond to, and analyze support requests is highly desirable and is avail- able through the customer support function of the chosen CRM module. Also, any enhancement to the application should be docu- mented, designed, and tested before being rolled into the pro- duction system. C h a p t e R 4 Conclusions, Recommendations, and Summary
46 Summary The L32C product not only represents a tool but also implies new requirements for business planning, staffing, and other resources to support an effective long-term process for mea- suring training effectiveness. Communications and Outreach An effective TIM assessment process will require the engage- ment of all potential stakeholders, since they will provide the primary inputs into the process. Therefore, the sponsoring agency should incorporate benefits-oriented messaging about TIM training effectiveness into its communications and outreach efforts to the potential user community.
