WHAT AN INTERVIEWER IS ACTUALLY SCORING

WHAT AN INTERVIEWER IS ACTUALLY SCORING

Most interview advice is written as though the interviewer is an audience you have to charm. In a well-run process they are closer to a marker working through a rubric, and the difference decides what a good answer is made of.

This is the part worth understanding before you rehearse anything, because it is the system you are being assessed inside — and it is not a secret.

WHAT A STRUCTURED INTERVIEW IS A structured interview is one where every candidate is asked the same questions, in the same order, and answers are rated against a defined scale. An unstructured interview is a conversation that goes wherever it goes, and is judged on overall impression.

That distinction is the single most studied thing in the field, and the gap between the two is not small.

Meta-analyses going back to McDaniel and colleagues in 1994 found structured interviews predicted later job performance substantially better than unstructured ones. Schmidt and Hunter's 1998 review placed structured interviews among the strongest predictors available to an employer, well ahead of unstructured conversation.

More recently, Sackett and colleagues (2022) re-ran those estimates with corrected statistical assumptions and reordered the rankings — but structured interviews still came out near the top, and still well clear of unstructured ones.

The finding that has survived every revision is the ordering, not the exact coefficient: asking everyone the same questions and rating the answers against a scale beats forming an impression. — What thirty years of meta-analysis agrees on

WHY THAT CHANGES YOUR ANSWER If you are being rated against a scale, three things follow.

Rapport is not the score. In a structured process the rating comes from what you said against defined criteria. Being likeable is not nothing, but it is not what is being written down.

Coverage beats fluency. A rubric has dimensions. An answer that is beautifully delivered but only touches one of them scores below a plainer answer that touches all of them.

Specifics are the evidence. Competency frameworks are almost always written in terms of observable behaviour — what you did, in what situation, with what result. An answer with no situation, no action and no outcome has not given the marker anything to mark.

!try Try this | Take your last interview answer and label each sentence: situation, action, result, or none of those. Most people find over half their sentences are "none" — context, hedging, and explaining what the team did. That is the part to cut. | Practise one answer →

WHY "TELL ME ABOUT A TIME WHEN" EXISTS Behavioural questions — "tell me about a time when you had to change someone's mind" — exist because of a specific finding: past behaviour in a comparable situation predicts future behaviour better than a candidate's own account of what they would do.

That is why the question is phrased in the past tense, and why an answer that slides into the hypothetical ("what I'd normally do is…") scores badly. It is not a trick. The question is asking for evidence, and a hypothetical is not evidence.

The STAR shape — Situation, Task, Action, Result — is popular because it maps onto that. It is worth knowing the shape, and worth knowing that situation is the least interesting part of it. Most people spend half their answer there.

WHAT INTERVIEWERS ARE WRITING DOWN In a structured process, usually a rating per dimension and a short justification. The justification is where specifics matter: a marker who has to write "gave a concrete example with a measurable outcome" needs you to have given one.

Levashina and colleagues (2014) reviewed the structured-interview literature and noted how much of the benefit comes from the rating discipline rather than the questions alone. Asking good questions and then forming a general impression gives back most of the advantage.

Interrater reliability — whether two interviewers independently arrive at the same rating — is consistently higher for structured formats. Conway and colleagues (1995) documented that gap. That is the practical reason panels use them: it makes the outcome less about who happened to be in the room.

WHAT THIS DOES NOT TELL YOU Plenty of interviews are not structured. Plenty of organisations claim a competency framework and then run a conversation. You will not know in advance which you are walking into, and there is no version of this that tells you whether you will get the job.

What it does tell you is what a good answer is made of when it is being marked — and an answer built from specifics survives an unstructured conversation perfectly well. The reverse is not true.

SOURCES McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., and Maurer, S. D. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79(4).

Conway, J. M., Jako, R. A., and Goodman, D. F. (1995). A meta-analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology, 80(5).

Schmidt, F. L., and Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124(2).

Levashina, J., Hartwell, C. J., Morgeson, F. P., and Campion, M. A. (2014). The structured employment interview: Narrative and quantitative review of the research literature. Personnel Psychology, 67(1).

Sackett, P. R., Zhang, C., Berry, C. M., and Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11).