Lessons learned in testing the feasibility of evaluating transfer of training to an operations setting

Introduction: The purpose of the study was to explore the feasibility, identify challenges, and offer solutions to evaluating transfer of training to the operations setting. Background: The assumption underlying public health emergency preparedness training is competencies and capabilities will transfer to the operations setting. However, there are no studies describing methods for evaluating the transfer of training. Methods: An online training course that mimicked field decision making was selected. A functional exercise was developed and aligned with the goals and objectives of the online course. Transfer of training was assessed at the individual capability level and at the agency level by examining changes in emergency operating plans. Conclusions: It was concluded the ability to evaluate transfer of training to an operations setting is feasible. However, it requires more deliberate and coordinated planning between the exercise and the training than the current status quo. Lessons Learned: Eight lessons learned are shared including the need to design training courses to align to an operation-based exercise, and not vice versa, the need to rely on qualitative approaches, and the need for an a priori evaluation rubric.