Best Practice
How to Build a Hiring Scorecard
Turn vague hiring expectations into clear, observable evaluation criteria before the first interview starts.
4 min read
Why hiring scorecards matter
“We need someone senior, strategic, hands-on and a great communicator.”
Ask three interviewers what would count as evidence, and you may get three different answers. A scorecard gives them shared criteria before anyone meets a candidate.
- Align recruiters and hiring managers before interviews.
- Define observable evidence for each criterion.
- Identify evidence gaps before the decision.
Structure supports consistent judgement. It does not guarantee an unbiased decision.
Start with outcomes, not adjectives
What must this person achieve? Define the capabilities behind those outcomes as behaviour you can observe.
Too vague
Strategic thinker
Better
Can translate business goals into a prioritised 6–12 month roadmap.
Too vague
Good communicator
Better
Can explain complex decisions to non-technical stakeholders.
Too vague
Senior
Better
Has independently owned decisions with cross-functional impact.
Too vague
Team player
Better
Actively resolves dependencies and conflicting priorities.
Build the Master Scorecard
The Master Scorecard is the single definition of what good looks like for this role.
Example criterion
Stakeholder Management
- What good looks like
- Resolve competing priorities across teams and reach workable agreements.
- Why it matters
- A must-have here: the role depends on Product, Engineering and Sales working together.
- Evidence to look for
- A concrete disagreement: what the person decided, why, and what changed as a result.
How to rate evidence: anchors and calibration
Define rating anchors for each criterion. They explain the judgement; the number only records it.
How to recognise strong evidence
The person names the competing interests, explains their own decision and a rejected alternative, and shows how the agreement affected delivery. Their contribution is distinguishable from the team’s work.
- 1: No evidence
- Mostly theoretical answers or no comparable experience.
- 2: Limited evidence
- Some exposure, but little individual ownership.
- 3: Solid evidence
- Clear example with personal ownership and a reasonable approach.
- 4: Strong evidence
- Multiple examples showing independent judgement in complex situations.
Before interviewing, rate a sample answer independently and discuss differences. Record the example, individual contribution and outcome alongside each rating. Anchors describe collected evidence, not the limits of someone’s capability.
“Not assessed” is not a low score. If there was no fair opportunity to show a capability, record an evidence gap.
The evidence depth framework
Choose how deeply to examine each criterion with the EuliAI CED Framework.
C: Confirm
Experience exists
“Worked on Project X”
Experience
E: Explore
Understand the depth
“My role was … I decided … because …”
Deeper evidence
D: Demonstrate
Observe capability
“Show us how you would approach it.”
Observed capability
CED in practice: two criteria, different paths
Follow the same Stakeholder Management criterion through three stages. Then compare Motivation: it starts with Explore and needs no practical task. TAP means Talent Acquisition Partner.
| Criterion | Recruiter / TAP Interview | Hiring Manager Interview | Assessment / Practical |
|---|---|---|---|
| Stakeholder Management | C · Confirm “At Company X, I worked with Product and Sales on Project Y.” Relevant experience exists. | E · Explore “My responsibility was X. When Product and Sales disagreed, I decided Y because …” Clarifies individual contribution, decisions and reasoning. Follow up on the impact. | D · Demonstrate The candidate handles conflicting stakeholder requirements in a realistic scenario. The capability can be observed directly. |
| Motivation | E · Explore Why this role, why now, and what are you looking for? Understand the reasons behind the move. | C · Confirm Validate expectations around role, scope and environment. Check that expectations match the actual opportunity. | No additional assessment No practical task needed for this criterion. Use the evidence already gathered; this is not a low score. |
Choose evidence depth for the criterion. CED does not assign interview ownership.
Distribute evidence across hiring stages
Build stage scorecards and Interview Guides from the same Master criteria and anchors. Give each stage a clear purpose:
- Assign each criterion an owner, an evidence depth and a question or task.
- Carry concrete evidence and open questions forward. A later stage should add, deepen or clarify evidence.
- Ask each interviewer to record their own judgement before the debrief, rather than inherit an overall verdict.
Good to know: fair tasks and interviewer expertise
Make practical assessments comparable: explain the task, time available and evaluation criteria, and give candidates equivalent opportunities to ask questions. Treat visible enthusiasm cautiously; preparation and engagement depend on the conditions you create, and should never become a proxy for personality or confidence.
A recruiter screen can include an in-depth technical assessment when the interviewer has the relevant expertise and remit. A hiring manager interview or practical task then addresses what remains open.
Record behaviour, not impressions
Useful observed evidence
“The candidate clarified conflicting requirements with both stakeholders before proposing a solution.”
Not useful evidence
“The candidate seemed confident.”
These observations supplement planned questions and tasks. They do not replace structured assessment.
Good to know: using observations fairly
Structured assessment creates a planned opportunity to test a criterion. Observed evidence emerges while the person is doing something else.
Record what happened, in which situation, and how it relates to the criterion. No opportunity to observe a behaviour means no evidence, not negative evidence.
Observation is not a fourth CED depth. Confidence and vague “culture fit” impressions must not stand in for capability.
Common scorecard mistakes
- The adjective trap
- Define observable behaviour, with an example of what good looks like.
- The unicorn scorecard
- Challenge every must-have. What can be learned on the job?
- The duplication problem
- Give each stage a specific evidence gap to close.
- The gut-feeling scorecard
- Agree criteria before interviewing; record evidence before the verdict.
- Fake precision
- Define anchors before numbers; calibrate with example answers.
A completed scorecard should explain the decision, not just record that the process finished. Read Time-to-Hire Is Not a Quality Metric for the distinction between process efficiency and decision quality.
Euli’s Scorecard Check
Use this check with the hiring manager before interviewing. Ticks are for this visit only.
Don’t want to build it from scratch?
EuliAI proposes criteria, evidence indicators, rating anchors and an assessment plan for your Hiring Kit. Your team reviews and edits the suggestions; stage scorecards and Interview Guides follow from the agreed plan.
Need a definition along the way? Explore the Recruiting Glossary for structured hiring and interview scorecard terminology.