The TASN Theory of Change guides the evaluation of each project. Each TASN project is required to develop, in collaboration with the TASN Evaluation team, an evaluation plan. The Evaluation Plan Template provides guidance for drafting the evaluation plans. These evaluation plans are then implemented to determine the impact of the TASN and each project.
TASN trainings are evaluated through a structured process. TASN aims to provide training that meets the needs of adult learners and builds the knowledge and skills of participants so that they can improve their practices. The evaluation of trainings includes the following.
- All TASN trainings are designed to address specific learning targets or learning objectives. These learning targets are typically provided in the training description so participants know what they will learn before registering for the training. Guidance is provided to TASN providers on Establishing Learning Targets.
- The TASN Training Evaluation asks participants to provide feedback on the quality of the training and their next steps in implementation. Participants are encouraged to complete the training evaluation, as this information is used to improve training content and follow-up support.
- Most TASN trainings include pre/post-assessment of knowledge. Aggregate data from these assessments are used to determine the effectiveness of each training in supporting participants to learn new information. These assessments are not used to determine the learning of individuals. Pre/post-assessments can be performance-based, but are typically multiple-choice quizzes. The Pre/Post-Test Guidance Checklist provides research-based suggestions for the development of multiple-choice quizzes.
- To ensure that TASN trainings are skill-based and address adult learning principles, the High Quality Professional Development Training (HQPD) Checklist is referenced when developing trainings. The presenters also self-rate and the evaluation team observes many trainings to monitor quality. Examples of activities/practices that meet each of the Checklist indicators can be found in this document.
- TASN trainings are designed to improve educational practices. To support implementation, many trainings are part of a series and include ongoing coaching. Fidelity measures and practice profiles provide participants with criteria for effective implementation of the practices. For more information please go to Module 7: Fidelity Assessment or Lesson 3: Practice Profiles in the Active Implementation Hub.
- The TASN professional development model adheres to implementation science research. Implementation Science drivers include selection, training, coaching, facilitative administration and performance assessment. Each project describes how the drivers are achieved and together with KSDE and the coordination and evaluation teams works to continually improve Evidence-Based Professional Development Implementation Practices.