A leadership competency assessment measures how well a leader demonstrates the specific skills and behaviors your organization has defined as essential for leadership, such as setting direction, developing people, or making decisions. It compares observed behavior against a competency model, so results show not just how someone leads but how that matches what the role requires.
The quality of a competency assessment depends far more on the competency model than on the tool. A vague model (“strategic thinker,” “good communicator”) produces vague ratings. A model written as observable behavior produces ratings people can act on.
Start with a usable competency model
Before comparing assessment tools, check that your competencies pass three tests:
- Observable: could two people watching the same meeting agree whether the behavior happened?
- Level-specific: does the model describe what the competency looks like for a first-line manager versus an executive?
- Connected to results: can you explain how each competency affects the team’s outcomes?
For example, “accountability” is a common competency but rarely defined well. A behavioral version reads: “Makes specific commitments with clear owners and dates; keeps them; renegotiates openly and early when they cannot be kept.” That definition, which reflects how DorWay describes accountability in leadership, can be observed and rated. “Takes ownership” cannot.
Methods for assessing leadership competencies
No single method covers every competency well. The table compares the main options.
| Method | Best for competencies like | Strength | Limit |
|---|---|---|---|
| Multi-rater survey | Developing others, communication, collaboration | Shows how behavior is experienced by many people | Ratings reflect relationships as well as behavior |
| Behavioral interview | Decision making, handling conflict, integrity | Probes real past examples in depth | Depends on interviewer skill and candor |
| Simulation or case exercise | Strategic thinking, prioritization, difficult conversations | Observes behavior under realistic pressure | Costly; one snapshot |
| Self assessment | Any, as reflection | Fast; builds ownership of development | Lenient; misses blind spots |
| Work sample or track record review | Execution, accountability, results orientation | Based on what actually happened | Hard to separate leader effect from context |
Self-ratings deserve special care. A meta-analysis by Heidemeier and Moser (2009) found self-ratings agree only modestly with supervisor ratings and are consistently more lenient. Use them as one input, not the verdict. Our guide to leadership self assessment covers how to reduce that bias.
How to run a leadership competency assessment
- Choose six to ten competencies. More than that and raters stop distinguishing between them.
- Write behavioral indicators for each. Two to four observable behaviors per competency, at the right level for the role.
- Pick at least two methods. For example, a multi-rater survey plus a behavioral interview. Agreement across methods increases confidence.
- Use a clear rating scale. Anchor each point with a description, such as “rarely demonstrates” to “consistently demonstrates and models for others.”
- Calibrate. When managers rate, bring them together to compare ratings and evidence before results are final.
- Debrief and plan. Every leader should leave with one or two competencies to develop and a specific plan.
- Re-assess. Repeat in twelve to eighteen months using the same indicators.
Common problems and how to avoid them
- Halo effect. A leader strong in one visible area gets high ratings everywhere. Behavioral indicators and multiple raters reduce this.
- Everyone scores “meets expectations.” A sign the scale anchors are vague or that ratings carry consequences raters want to avoid.
- Competencies nobody uses. If the model is not used in hiring, promotion, and development, people stop taking it seriously.
- Measuring traits instead of behavior. Personality tests describe tendencies, which can be useful context, but competency assessment should focus on what leaders do.
The competency most models underweight
Most competency models include communication, strategy, and people development. Fewer give real weight to how leaders handle commitments, even though it underlies all three. DorWay sees organizations as a Network of Agreements™: most breakdowns, from conflict to missed targets, trace back to agreements that were never specific enough to keep. Leaders who make clear requests, keep their word, and renegotiate openly create teams where other competencies can work. The PACT™ Leadership Assessment measures this directly, and the eight leadership practices describe the behaviors in detail.
For a broader comparison of instruments, see our guide to leadership assessment tools. To understand the factors behind effectiveness overall, read what actually makes a leader effective.
FAQ
What is a leadership competency assessment?
It is an evaluation of how consistently a leader demonstrates the behaviors defined in an organization’s leadership competency model, usually using several methods such as multi-rater surveys, interviews, and simulations.
What are the most common leadership competencies?
Typical models include setting direction, decision making, communication, developing others, building relationships, driving results, and accountability. The best models describe each one as observable behavior at each leadership level.
How is a competency assessment different from a personality test?
A personality test describes preferences and tendencies. A competency assessment evaluates actual behavior against a defined standard. Personality can explain why a competency is hard for someone, but it does not measure the competency itself.
How often should leadership competencies be assessed?
Every twelve to eighteen months is common for development purposes, with lighter check-ins on the one or two competencies a leader is actively working on.