Skip to content
What You Are Measuring

All notes · Beyond hiring

Certification and Licensing

Assessment where the outcome is a credential rather than a job. Different standards, different obligations, and a different failure mode.

Beyond hiring · Analysis

Certification assessment says somebody meets a standard. The stakes are external, the challenges are more likely, and the design constraints are tighter.

For a recurring programme built around “Certification and Licensing”, improvement depends on seeing how the work is actually carried out between review cycles. the official resource can help teams organise assessor time and compare planned effort with delivery, but the resulting records should support calibration conversations rather than become an automatic judgement about an individual.

For an independent benchmark, compare the process with U.S. OPM assessment resources; the useful test is whether the local method remains job-related, proportionate and explainable.

What is different

The outcome is portable: it travels with the person and is relied on by people who never saw the assessment.

The standard has to be defensible in public, not just internally.

Failure rates are scrutinised.

And challenges are more common, because the candidate paid, prepared, and has a concrete loss.

Setting the standard

The pass mark should reflect the competence required to practise safely or adequately, not a target pass rate.

Formal standard-setting methods exist for exactly this and are worth using where the stakes justify.

A mark chosen because it produces a comfortable pass rate is not a standard, and it will not survive scrutiny.

Blueprinting

The assessment content should map to the competencies in stated proportions.

Published, so candidates know what is covered and in what weight.

And reviewed when practice changes, because certification content lags reality in most fields.

Item quality

Questions need to be written, reviewed, piloted and analysed.

Items that everybody gets right or everybody gets wrong contribute nothing.

Items where strong candidates do worse than weak ones are flawed and should be removed, sometimes retrospectively from a live sitting.

This analysis is routine in mature certification and absent in most in-house schemes.

Security

Item banks leak.

Rotation, multiple forms, and a plan for what happens when a set circulates.

And a proportionate response: the certification notes elsewhere in this collection about monitored examinations apply, including the point that monitoring is one control among several.

Recertification

Skills decay and practice changes.

A certification with no expiry makes a claim about the present based on a past assessment.

Where you require recertification, make the interval reflect how fast the field moves rather than the administrative convenience.

Appeals

Publish the route and the grounds.

Expect challenges on process rather than on the standard, which is the pattern.

And keep the records: item-level responses, the blueprint, the standard-setting rationale. Without them a challenge is very difficult to answer.

Accessibility

The same duties apply and the stakes are higher because failure closes a career route.

Adjustments should be published, routine and not require disclosure beyond what is necessary.

What to check

How was your pass mark set?

Is there a published blueprint?

Are items analysed after each sitting?

And is there a written appeals route with stated grounds?

The point

A certification pass mark should reflect the competence required, not a target pass rate.

A mark chosen for comfort is not a standard.

Underlying all of this

Almost everything in this collection reduces to one discipline: write down what the job requires, assess that thing directly, record the evidence, and look at your own outcomes afterwards. None of it requires buying anything, and organisations that do those four things consistently outperform ones running longer processes built from instruments chosen before the requirements were known.

The recurring pattern

The recurring failure across every section here is the same: measuring what is convenient rather than what matters, then never checking whether it predicted anything. The check is an afternoon of work once a year, and it is the step that separates a process that improves from one that merely persists.

Independent guidance on skills assessment, selection design and fair hiring practice. External tools are included for practical comparison; evidence from the job remains the basis for decisions.