Reflecting on Results: The Evaluation Phase of ADDIE 📊

We've journeyed through the Analysis, Design, Development, and Implementation phases. Now, it's time to close the loop with the Evaluation phase of the ADDIE model. This phase is fundamental for determining the effectiveness of your instructional design and for identifying areas of improvement (Wilson, et. al., n.d.; Land, 2024). Let’s explore how to effectively conduct evaluations.

Canva Image

Understanding Evaluation 📏

Evaluation is the process of assessing whether the instructional goals have been met and identifying opportunities for improvement. There are three main types of evaluation: formative, summative, and confirmative (Wilson, Sahay, & Calhoun, n.d.; Land, 2024).

Formative Evaluation 🔍

Formative evaluation occurs throughout the instructional design process, and it helps identify areas for improvement before full-scale implementation (Treser, 2015). This can involve:

1. One-to-One Evaluation:

• Select a few learners who are representative of your target audience.

• Evaluate the clarity, usefulness, and relevancy of instructional materials

1. Small Group Evaluation:

• Conduct sessions with a small group of learners.

• Gather feedback on engagement, relevance, and effectiveness of the activities.

1. Field Trial:

• Implement the training in a setting similar to the actual learning environment.

• Assess the overall efficacy of the training under realistic conditions.

Summative Evaluation 📝

Summative evaluation assesses the overall effectiveness of the instructional program after its implementation. This can involve evaluation models like the Kirkpatrick Model or the Success Case Method Model (Wilson, et. al, n.d.; Moore, 2017).

Kirkpatrick Model

• Reaction: Gather learners' feedback on the training experience through surveys (Kirkpatrick's Level 1).

• Learning: Measure the knowledge and skills acquired using tests and assessments (Kirkpatrick's Level 2).

• Behavior: Observe changes in learners' behavior and application of skills in real-world settings (Kirkpatrick's Level 3).

• Results: Evaluate the impact on organizational goals, such as improved productivity or reduced costs (Kirkpatrick's Level 4).

Success Case Method Model (SCM)

To learn more about these models, click on each word to read more about them: Kirkpatrick / SCM.

Confirmative Evaluation ✅

Confirmative evaluation assesses the long-term impact and sustainability of the instructional program. This involves periodic reviews to ensure that the training continues to meet the organizational goals and intervene to make any needed changes in the learning environment Dirksen (2024).

The Evaluation phase is critical for understanding the success of your instructional design. By conducting thorough formative, summative, and confirmative evaluations, you can ensure that your training programs are effective and continuously improving. Remember, evaluation is not just a final step but an ongoing process that feeds back into the entire ADDIE cycle.

Next, we will delve into a simpler and more agile version of ADDIE, the Successive Approximation Model (SAM). Stay tuned for insights on leveraging this model to make learning design and development more recursive.

For now, join the conversation: How do you incorporate evaluations into your instructional design process? Share your strategies, challenges, and insights below!

References

1. Dirksen, J. (2024). Talk to the elephant: Design learning for behavior change. New Riders.

2. Gardner, J.C. (2011, October 8). The ADDIE evaluation phase [Video]. YouTube. https://www.youtube.com/watch?v=CBoI0wBo4vw

3. Land, S. (2024). Instructional design for dummies. John Wiley & Sons, Inc.

4. Moore, C. (2017). Map it: The hands-on guide to strategic training design. Montesa Press.

5. Treser, M. (2015, September 30). Getting To Know ADDIE: Part 5 – Evaluation. https://elearningindustry.com/getting-know-addie-evaluation

6. Wilson, M., Sahay, S., & Calhoun, C. (n.d.). ADDIE Explained: Evaluation. https://oercommons.org/courses/addie-explained-an-open-educational-resource-for-the-educational-technology-community/view