Evaluating Learning and Capability Investment: Beyond Completion Rates
Everything you need to know about evaluating learning and capability investment properly — beyond completion rates, beyond satisfaction scores, and into evidence a board will actually trust.
Why completion rates aren't evaluation
Completion confirms an intervention reached its intended audience. It says nothing about whether behaviour, performance or risk actually changed as a result — which is the only question evaluation exists to answer. Reporting completion as if it were evaluation is one of the most common and costly habits in this field.
Kirkpatrick's model in practice
Kirkpatrick's four levels — reaction, learning, behaviour, results — remain the standard reference model for evaluation, and for good reason: they force a distinction between how people felt and what actually changed. The dedicated article covers where the model is genuinely useful and where it breaks down in practice.
Why satisfaction scores don't prove impact
High satisfaction and zero measurable impact can and do coexist — people can enjoy an intervention that changed nothing about their subsequent performance. Satisfaction is worth tracking, but it answers a different, much narrower question than 'did this work.' The dedicated article explains why the two get conflated so often.
Building an evaluation plan before a programme starts
Evaluation planned after a programme has already launched is mostly guesswork, because the baseline needed to prove anything changed no longer exists. The dedicated article covers what needs deciding — and measuring — before day one.
Measuring ROI on capability investment for board reporting
Capability investment ROI is harder to quantify than financial ROI, but that doesn't mean it can't be credibly reported — it means being honest about what can be quantified, what should be reported qualitatively, and presenting both in a form a board will actually trust. The dedicated article covers how.
What good evaluation actually requires
Good evaluation requires a baseline captured before the intervention, a defined measure of the outcome that actually matters, and a realistic timeframe for that outcome to show up. Skip any of the three, and the resulting evaluation — however sophisticated the model behind it — is not defensible.
What this looks like in practice
The Healthcare Learning Transformation case study is direct evidence of evaluation done well: cutting compliance gaps by 18% was measurable precisely because dashboards and reporting were designed around the outcome that mattered to leaders, not around whatever the platform generated by default.
Common questions on this topic.
Yes, as an operational delivery metric confirming the intended audience was reached — but it shouldn't be reported as evidence that the intervention worked.
A simple before-and-after measure of the specific outcome the intervention targets, captured before launch — sophistication in the model matters less than having a genuine baseline.
It depends on the outcome — some behaviours change quickly, others take months to show up in the data. The evaluation plan should set this expectation before launch, not guess at it afterwards.
With the evaluation planning article below — most of the value in evaluation comes from decisions made before a programme starts, not from the analysis done afterwards.
Want this thinking applied to your organisation?
Insight is useful. Applied insight changes outcomes. Let's talk about yours.