When Hiring Assessors Disagree: Reconcile the Evidence

Two assessors review the same candidate work sample. One scores the response highly because it identifies a missing approval. The other scores it poorly because the task remains unfinished. Averaging their numbers would conceal the real disagreement: what did the exercise require the candidate to do when authority was missing?

Before shortlisting, compare the evidence against the criteria agreed before the exercise. Preserve each assessor’s initial rating, identify the disputed interpretation and record how it was resolved. This moderation record is an illustrative review tool, not a validated selection method or a guarantee of the right hire.

Start with the original brief and criteria

Use the exact version candidates received, including the permitted tools, instructions and relevant role boundaries. Reviewers should not introduce an expectation that was absent from the exercise. A preference for a particular writing style should not quietly become a new essential criterion after responses arrive.

The US Office of Personnel Management’s work-sample guidance describes assessing tasks that mirror job activities. Here, the practical question is whether both assessors are evaluating the same job requirement and the same observable response. This source informs assessment design; it does not establish Nepal employment rules.

Clarify the relevant capability in the recruitment brief before choosing the task. Moderation can expose ambiguity but cannot retrospectively create a fair instruction.

Preserve the independent assessments

Have each assessor record their initial judgment and supporting passage before the discussion. Separate what the candidate actually wrote from the reviewer’s inference about it. “Identified approval gap in paragraph three” is evidence; “probably lacks confidence” is an interpretation that may not be justified by the exercise.

Do not replace the original ratings with an unexplained consensus number. Retaining the starting positions shows where reviewers differed and whether the discussion changed the judgment because of evidence or because someone more senior preferred another outcome.

Use a moderation record for the disputed criterion

This fictional example does not mean escalation always deserves a high score. A candidate might identify the owner but provide no useful evidence, or stop all work when the brief allowed unaffected tasks to continue. Assess the complete stated criterion.

Separate reviewer error from an unclear exercise

If the brief clearly defines the boundary, reviewers can resolve their interpretation against it. If it does not, acknowledge the ambiguity. The hiring owner should decide a consistent treatment for similarly affected responses with appropriate HR input, rather than changing the benchmark to favour one candidate.

DCV’s delegation worksheet can help express the work behaviour being assessed: permitted action, evidence for the owner and the specific hold. Include that language in a future brief only where it reflects the actual job.

Record the decision before discussing the shortlist

Close the moderation entry with the relevant evidence, agreed treatment, remaining uncertainty and decision owner. Keep candidate information within the approved recruitment process. A concise record should explain the criterion without reproducing unnecessary personal details.

Then consider the work sample alongside the other job-relevant evidence. A short exercise has limits, and agreement between reviewers does not erase those limits. After the round, update unclear criteria for the next version and identify any reviewer guidance needed. Related DCV role and operational articles can support that work. The immediate outcome is an explainable assessment decision that preserves the evidence and applies the requirement the candidate was actually given.