How to evaluate the effectiveness of patient education programs

Patient education can affect care quality — but the results, such as lower readmission rates and better treatment adherence, only happen if patients can remember or act on what they were taught. However, studies show patients routinely forget information about their care after hospitalization.

About half of discharged patients remember key components of their care. One-third forget at least one important aspect, and nearly 60 percent miss some or all details about their medication changes. (Sunyoung Oh, Hannah Choi, Eui Geum Oh, Ji Yea Lee. Effectiveness of discharge education using teach-back method on readmission among heart failure patients: A systematic review and meta-analysis ScienceDirect. 2023) So, how do we know when patients truly understand and can act correctly?

Many programs evaluate patient education by tracking completion: modules finished, handouts distributed, and patients reached. Those numbers document activities, but they don’t answer the question for clinical leadership or any internal stakeholders: did the education change anything?

This article shares an actionable framework to answer that. Drawing from Blue Carrot’s experience delivering e-learning for healthcare, we’ll explain what to assess, what tools to use, and how to measure patient education step-by-step. 🤩

Summary

1. What “effectiveness” means in a patient education program
2. A framework for evaluating patient education effectiveness
3. Methods and instruments to measure patient education outcomes
   • HCAHPS and education satisfaction surveys
   • Teach-back and show-me demonstrations
   • PAM-13, MMAS-8, and MARS-5
   • Clinical and system outcomes
4. A step-by-step process to evaluate a patient education program
5. How program format affects what you can measure in patient education
6. Common pitfalls when evaluating patient education programs
   • 1. Taking “yes, I understand” as proof
   • 2. Using satisfaction as an indicator of outcomes
   • 3. Relying on one data source
   • 4. Ignoring other confounding variables
7. Conclusion

What “effectiveness” means in a patient education program

Patient education effectiveness means the changes in the patient’s knowledge, behavior, and clinical status after receiving the program.

To better understand how to evaluate effectiveness of patient education, let’s first understand the difference between outputs and outcomes:

• Outputs measure those obvious program activities, e.g., videos produced, modules completed, handouts distributed, and patients reached.
• Outcomes are the changes those outputs are designed to support, e.g., a patient refills a prescription on schedule or recognizes when to call their provider.

Simply put, effectiveness measures patient education outcomes. The trends shaping medical training also point in the same direction: measurable impact matters more than only patient satisfaction or activity.

In practice, “the patient understood the information” and “the patient acted on it” are two separate events. Patients may pass a post-test at discharge or rate their education experience highly, but they still don’t follow a medication regimen at home — especially when the instruction is complex or uses unfamiliar terms.

A program receiving good test results at discharge may show a high readmission rate. Ultimately, every evaluation must answer two important questions:

1. Did the intervention cause the change?
2. Was the change worth the cost?

A framework for evaluating patient education effectiveness

To reliably measure a patient education program, you need a framework that distinguishes between activity and impact. The Kirkpatrick model for patient education provides that. Originally developed for workforce training, it evaluates the impact of learning in four levels: Reaction, Learning, Behavior, and Results (Kirkpatrick Partners. The Kirkpatrick Model. 2024).

The model moves from measuring activities to assessing practical application. Importantly, it recognizes the need for a supportive environment where the new behavior can be sustained. We suggest a few adjustments in the patient education context:

1. Patients are not employees. Employee training assumes an environment where employees have accountability, oversight, and practice. Patient education is often one-off, high-stress, and without direct oversight.
2. Long-term follow-up matters more, especially in the home environment.
3. Clinical outcomes are more relevant at the results level than productivity metrics.

You can apply the four levels of the Kirkpatrick framework to a patient education program evaluation:

Methods and instruments to measure patient education outcomes

The framework tells you what to measure at each level. What you need next are the tools to measure it. We suggest making an evaluation credible by collecting more than one data source for each layer of learning. Based on Blue Carrot’s experience designing healthcare learning programs, combining different data types can provide a more complete picture of how learners respond and apply knowledge.

📌 HCAHPS and education satisfaction surveys

The HCAHPS (Hospital Consumer Assessment of Healthcare Providers and Systems) survey is a nationally standardized, publicly available survey of patients’ perspectives on hospital care (HCAHPS: Patients’ Perspectives of Care Survey. Centers for Medicare & Medicaid Services CMS Newsroom CMS Newsroom. 2025). It captures patient feedback on nurse and physician communication, discharge information, and the hospital environment.

HCAHPS falls under Level 1 (Reaction), measuring what the patient perceived. It doesn’t predict self-management or medication adherence, so use it diagnostically to understand how patients perceived this training.

For L&D teams, link each module to the HCAHPS and discharge items it should improve. Then, align relevant post-module surveys with these areas where appropriate.

📌 Teach-back and show-me demonstrations

The teach-back method checks the patient’s understanding by asking them to restate care instructions in their own words (Health Literacy Universal Precautions Toolkit. AHRQ. 2020).

For example: “I want to make sure I explained this clearly. Can you tell me what you’ll do when you get home?” If a patient misrepresents the information, the clinician tries again with a different approach.

The show-me method asks patients to demonstrate a task, such as drawing up an insulin dose or operating an inhaler. It can catch gaps that a verbal check may miss.

Both methods can support education and provide a check of understanding or task performance at Level 2 (Learning). Their effectiveness depends on the clinician delivering them, so staff need proper training and enough time with each patient.

For L&D teams, incorporate scripted teach-back prompts and show-me checks into the course’s scenarios.

📌 PAM-13, MMAS-8, and MARS-5

While the methods above and pre- and post-tests assess whether or not the patient understands, the tools below provide information about what the patient does in daily self-management.

• The Patient Activation Measure (PAM-13) is a 13-item, Rasch-calibrated instrument scored 0–100 across four activation levels. It captures how confident and capable patients feel about managing their condition.
• The Morisky Medication Adherence Scale (MMAS-8) is an 8-item self-report tool that classifies medication adherence as high, medium, or low. Patients who score less than 6 are considered non-adherent.
• The Medication Adherence Report Scale (MARS-5) is a 5-item scale (scored 5–25) that asks patients how often they forget, alter, or skip doses.

These tools can contribute to Level 3 (Behavior). Medication adherence and patient activation are the common outcomes of patient education programs. It’s worth noting that these assessments are based on patient self-reports, which have a tendency to overstate adherence.

For L&D teams, consider incorporating an appropriate activation or adherence measure into the course plan.

📌 Clinical and system outcomes

Clinical and system outcomes are the Level 4 (Results) indicators of a program. These are the numbers that matter to payers, clinical leadership, and quality teams.

That said, clinical outcomes generally occur months later and are affected by other factors outside the education program. So, a change in these numbers cannot be attributed to training alone without a controlled study.

A step-by-step process to evaluate a patient education program

It’s the same thinking you use to build a medical leadership training program: start with defining what success looks like before moving to course production.

1. Decide what you want to change. For example, do you want patients to take their medications on schedule or use a new device correctly at home?
2. Map intended changes to a framework. For each change, name the Kirkpatrick level it maps to, then pair it with appropriate data sources, such as self-management assessments with pharmacy records.
3. Capture the baseline. Before training begins, collect data such as PAM scores, adherence scales, and knowledge pre-tests.
4. Embed measurement in the program’s delivery. For example, include teach-back questions in different scenarios and knowledge checks in the modules. Participants rarely complete the measurement when it is separated from the main content.
5. Measure immediately after the education session. Capture post-test scores on knowledge, record teach-backs, and assess understanding at discharge.
6. Follow up at a scheduled interval. CMS uses 30-day readmission measures, and HCAHPS surveys run from 48 hours to 6 weeks after discharge. Follow-up on behavior, adherence, and patient activation depends on conditions and target outcomes. 
7. Analyze the results and iterate. Compare the data to a control or comparison group (where possible), and clearly state confounding factors. Use the results to iterate on content, delivery, and timing for future participants.

How program format affects what you can measure in patient education

Even when learning objectives and end goals are similar, different formats — whether printed, a scripted video, or multimodal learning — produce different data and support different plans for patient education evaluation.

From our experience, a single program can blend several of these formats. The programs that produce the most valuable evaluation data build measurement in from the start. Our custom e-learning development services assess your learning objectives and choose the format that fits them.

Common pitfalls when evaluating patient education programs

As we discussed earlier, patients often forget their care instructions soon after learning them. The pitfalls below cover the common root causes and how to avoid them.

👉 1. Taking “yes, I understand” as proof

Patients often say yes even when they are confused. Health literacy in this case may be overlooked. Instead of relying on patient affirmation, use the teach-back method or show-me demonstration to see if you have explained the instructions well enough.

👉 2. Using satisfaction as an indicator of outcomes

Patient satisfaction scores don’t tell you if the content was understood, accessed, used, or caused behavior change. Research on patient portals suggests a gap between patients’ stated interest in educational resources and their actual use. Studies found that 84–89% of patients wanted educational resources available through patient portals and reported plans to use them frequently. (Adam M. Johnson, Department of Human. A Systematic Review of the Effectiveness of Patient Education through Patient Portals – PMC. NCBI. 2026).

So, treat satisfaction data as a diagnostic signal, showing whether patients found the content useful rather than whether they learned from it. Always pair it with a direct measure of learning or behavior.

👉 3. Relying on one data source

Self-report surveys tend to overstate use and adherence. Instead, include at least one additional source for each outcome of interest, such as EHR data, portal logs, or pharmacy data.

👉 4. Ignoring other confounding variables

Patient education is only one of many variables that affect outcomes. Giving your education program full credit for any behavior change exaggerates its influence and obscures the role of other factors.

Consider using comparison or control groups and clearly acknowledge in your reports any variables that may have contributed to the change.

Conclusion

Activity metrics describe what the program delivered, such as modules completed and patients reached, but they are not the finish line. Measuring patient education effectiveness means asking what patients know after the program, what they do at home, and whether clinical results changed.

Effectiveness is measurable through the appropriate framework and tools. That’s why measurement methods should be treated as a design requirement early in the planning phase. If you are building new patient education content, work with a partner that keeps “evaluability” in mind from the start.

Blue Carrot produces patient-facing video, animation, and interactive content in healthcare. Our custom e-learning solutions for healthcare organizations can help audit your existing program or build a new one tailored to your goals. Book a call with us.