Most mentorship program evaluations measure the least useful thing. Not because the people running them are careless. Because the measures that are easy to collect and defend are the ones that have the least to do with whether the program is changing anyone.
Participant satisfaction scores. Session attendance rates. Number of mentorship pairs formed. Hours logged. These get reported to leadership because they are easy to compute and produce a chart. They also correlate weakly, sometimes not at all, with whether the mentees ended up different.
If you are running a mentorship program, or evaluating one someone else is running, here is what actually matters and how to measure it.
What the program is designed to change
Before you can evaluate the program, you have to answer one question honestly. What are we trying to change about the people who go through this?
The answers cluster into three groups.
Skill acquisition. The mentee learns to do something they could not do before. Present to executives. Manage a P&L. Handle a difficult negotiation. Concrete, observable.
Judgment. The mentee develops the ability to make better decisions in situations where the answer is not obvious. Harder to observe, but visible over time in what they choose.
Practice. The mentee starts operating differently as a matter of habit. Not doing new things once. Doing new things consistently.
Most programs claim all three. Most measure none of them.
What to measure, honestly
For each group, there is a way to measure without kidding yourself.
Skill acquisition. Compare the mentee’s ability to do the specific skill before the program and six months after, with an evaluator who is not their mentor and does not know the design. If the ability changed, the program contributed. If it did not, the program did not.
Judgment. Ask the mentee’s manager three specific questions after the program that they would have struggled to answer before. Not “are they a better leader now.” Something like “if someone on your team missed a critical deadline without telling you, describe what you would do differently now than a year ago.” Whether the answer shows a change is what tells you.
Practice. Track a small number of concrete behaviors. Does this person now make specific requests, where they used to make vague ones? Do they follow up on commitments they receive, or accept nods? Do they renegotiate agreements before deadlines, or discover slips after? These are observable. They are also the practices that actually determine effectiveness.
Notice what is not on this list. Session satisfaction. Program NPS. Attendance. Those are process measures. They tell you the program is running, not that it is working.
The three things most mentorship programs miss
Even a program that measures well often fails at the same three points.
The mentor is not accountable for anything specific. Most programs pair mentors and mentees and leave the content of the relationship to them. That is fine if both parties are experienced and the mentee is clear about what they need. It is not fine as a design assumption. If the mentor has no specific role, no specific practice they are trying to build in the mentee, and no way to know whether they are succeeding, the relationship becomes a series of pleasant conversations with no direction.
The mentee is not accountable for anything specific. The mentee is being given time by a senior person. That is a resource. If the mentee is not committing to specific practices between sessions and reporting on them, the resource is being consumed without an obligation on the receiving end.
There is no support between sessions. Mentorship meets once a month, or once a quarter. Most of what a mentee actually needs to work on happens in the ten minutes before a difficult conversation, not on the calendar. Without support in the moment, the program is a series of conversations about things that happened weeks ago. This is why we built D3X™. Support in the moment closes the gap.
What good evaluation looks like
If you want to run a mentorship program that is worth evaluating, and evaluate it in a way that tells you something real, four elements have to be present.
A specific outcome. Not “leadership development.” A named change you can describe before the program starts.
Specific practices. What is the mentee going to practice, in real situations, in the weeks between sessions? If you cannot name them, the program is a conversation series.
Specific tracking. What is being measured between sessions? By whom? Reviewed how often?
Specific consequences. What happens if the practice is not happening? Not blame. A conversation about what got in the way and what the person will try next.
Programs that have all four produce measurable changes. Programs that have any missing produce hours logged and satisfaction scores. Those are not the same thing.
How we think about mentorship at DorWay
Mentorship is one form of human support inside a system. It is not the whole system. It works when it is embedded in a broader practice framework, not when it stands alone.
The Leaders Edge Path™ is that framework. Eight practices, beginning with integrity, that give a mentor and a mentee something specific to work on together. Without a framework, mentorship becomes advice. With one, it becomes practice.
The LIFE Journey Evaluation™ is the evaluation we start with. It gives the mentor and the mentee a shared view of where the person is currently operating and what a next practice would be.
Evaluate a mentorship program on whether the mentees end up practicing something they were not practicing before, in real situations, consistently. That is the number that matters. The rest is process.
Sandor Kovacs CEO and Co-Founder, DorWay™
FAQ
What is the best metric for mentorship program success?
The change in specific behaviors and practices of the mentees, observed six to twelve months after the program, by evaluators who do not know the program design. Everything else is process.
How often should mentorship pairs meet?
Frequently enough to keep the practices alive between sessions. For most programs, every two to four weeks with support available in between produces better results than monthly meetings with nothing in between.
Should mentorship programs be voluntary or required?
Voluntary on the mentee side. Required attendance without commitment produces process, not change.