What if you weighted skills higher? Watching a shortlist move

Every criterion on the Scoring Health tab has its own slider, and each one moves ten points either side of its baseline weight. Drag one and the top 10 list updates at once. No scoring run starts and no stored score changes.

The seven sliders are Skills Match, Experience, Education, Semantic Fit, Practicalities, Engagement Profile and Stability & Trajectory. A criterion the job weights at zero can only be raised to 10. The “How are scores calculated?” link in the tab’s intro opens a short page on the scoring process.

What if Skills Match counted for more?

Say you are hiring a senior backend engineer and you think skills should count for more than the baseline gives them. Raise Skills Match, then read the arrow on each row of the top 10 list. The arrow shows how many places the candidate moved against the baseline order. “↑1” means one place higher, “↓2” means two places lower, and “same” means no change.

Illustrative example. The candidates and ranks below are hypothetical and do not come from a real pool.

Candidate B is strong on Experience and thinner on Skills. Candidate C is the reverse. Neither profile is better in general. Their places depend on how much the job weights skills.

B, C and D changed place, and A held first in this example. B fell the furthest, so open B’s profile first. A two-place drop is a reason to read the profile. It is not a reason to remove the candidate.

What if the top of the list only holds under today’s weights?

Drag Skills Match five points above the baseline, then five points below it. After each move, read the stability message below the top 10 list. It compares your current top five with the baseline top five and shows one of three messages.

• If four or five of the baseline top five are still there, it says the top 5 mostly holds with these weights. Treat that as “this order did not change”, not as proof the ranking is right: in our benchmark, doubling the Skills weight changed the top 5 in 16 of 71 jobs, so weights have limited leverage and a steady top 5 is weak evidence.
• If two or three are still there, it says the shortlist is shifting and gives the number of the top five that change.
• If at most one is still there, it says the shortlist is sensitive to weight changes and recommends a manual review before you finalise.

A reshuffle usually means several candidates sit close together on total score.

On first load, before any slider moves, a panel titled “Candidates who rise with a weight shift” lists people from outside your top five who would move into the top five under a single 10-point nudge to one criterion, climbing three or more places. Check those profiles before you settle on the five.

Our view: a top five that changes under a five-point nudge should get a person’s read before anyone relies on its order.

What if one criterion does not separate candidates?

Further down the tab, a box plot shows how each criterion’s scores spread across the pool. Each row has the criterion name, a label of flat, weak or good, and a standard deviation figure. On each row, the box covers the middle half of candidates and the whiskers run to the lowest and highest score. The plot needs at least three scored resumes. Below that, it asks you to score more.

Take Education. Suppose its box is flat, with most candidates scored in a narrow band. Heavy weight on a flat criterion will not improve the ranking. It flattens the differences that exist. Check the box before you give a criterion more weight, then drag its slider and read the arrows. Your own pool will show whether the criterion moves anyone.

A box sitting low on the scale means the pool is weak on that criterion whatever the weights. That points to sourcing. A box near the top may mean the criterion is not separating these candidates, so extra weight may not help.

Keeping a weight set

Presets are a starting point. Pick an industry or a role level and the sliders load that weight set, scaled to 100 percent. The industry weight presets help page lists each industry’s weights. Choosing a preset also moves the baseline, so each slider’s ten-point range moves with it. When you settle on a set worth keeping, select Save as preset, give it a name and save it.

The weights total under the sliders can sit away from 100 as you drag. Scores are still normalised, so that total is not an error.

What the sliders do not change

Every change on this tab is a simulation. Candidates are not re-scored, and stored scores stay as they were. You are looking at the scores you already have, ordered under different weights.

When the job has scored candidates, the tab’s banner points you to Scoring Setup to re-run scoring with the new weights.

Try it on a job you have already scored. Drag Skills Match up five points, then down five, and read the message after each move. If it says the shortlist is shifting or sensitive to weight changes, open the profiles of anyone whose arrow moved before you send a calendar invite.