Supplier evaluation scorecards: KPIs, weighting and review meetings

Suppliers & risk · By the Buyer's Ledger editorial team · Published 2026-10-12

A hand holding a pen ticks boxes on a handwritten checklist in a squared notebook — Ticking off a checklist by hand. A scorecard works only if every KPI is defined as precisely as a checkbox.

A supplier scorecard turns "this supplier is good" or "they are always late" into a small set of measured indicators, reviewed regularly with the supplier. Done well, it focuses both sides on the few things that matter and gives an objective basis for decisions about volume allocation, development or exit. Done badly, it becomes a monthly spreadsheet nobody reads.

Selection versus performance

Two kinds of evaluation are often confused. Supplier selection (pre-qualification and tender evaluation) asks whether a supplier can meet the requirement, based on capability, financial standing, certifications and references. Performance evaluation asks whether a supplier is meeting it, based on data from actual deliveries. A scorecard is the tool for the second. The selection side is covered in RFI vs RFP vs RFQ.

Choosing the KPIs

Most scorecards draw from six families of indicators. Pick a handful that reflect what matters for the category; five to eight indicators is usually enough.

Quality

Defect rate, often expressed in parts per million (PPM): defective units received divided by total units received, multiplied by one million.
Lots rejected at incoming inspection as a share of lots received.
Corrective action responsiveness: time taken to contain a problem and to close a corrective action request.

Delivery

On-time delivery (OTD): deliveries arriving within an agreed window around the confirmed date, divided by total deliveries.
On-time in-full (OTIF): deliveries that are both on time and complete in quantity. Stricter than OTD and closer to what operations feel.
Lead-time adherence and confirmation of orders within an agreed time.

Cost

Price versus contract or versus an index, for categories where prices float.
Delivered cost savings or cost avoidance against an agreed baseline.
Invoice accuracy: invoices matching PO and receipt at first pass.

Service and responsiveness

Service level agreement (SLA) attainment for services: response and resolution times, availability.
Quality of communication and account management, often scored by internal users on a defined scale.

Risk and compliance

Status of required certificates (for instance ISO 9001 for quality management or ISO 14001 for environmental management), insurance and audits.
Financial health signals and business continuity plans for critical suppliers (see supplier risk and resilience).

Sustainability and innovation

Provision of emissions data or progress on agreed reduction targets, increasingly needed for the buyer's own reporting (see supply chain due diligence).
Improvement or innovation proposals made and implemented.

Define every KPI precisely

The most common reason scorecards are disputed is ambiguous definitions. For each indicator, write down:

the exact formula, numerator and denominator;
the data source (ERP goods receipts, quality system, user survey) and who owns it;
what counts as "on time" (the date requested, or the date the supplier confirmed? a window of how many days?);
exclusions (deliveries delayed by the buyer's own changes should not count against the supplier);
the measurement period and frequency;
the target and the thresholds for each score band.

Share these definitions with the supplier and, for important contracts, attach them to the contract. Under the UK Procurement Act 2023, public bodies must set and publish KPIs for larger contracts, which makes precise definitions all the more important.

Scoring and weighting

Raw KPIs come in different units, so they are usually converted to a common scale, for example 0 to 4 or 0 to 100, using bands. An illustrative band set for OTIF might be: below 85% scores 1, 85 to 92% scores 2, 92 to 97% scores 3, above 97% scores 4. The thresholds are a business decision, not a universal standard; set them from your own requirements and history.

Weights then reflect priorities. For a component supplier to a production line, quality and delivery may carry most of the weight; for a marketing agency, service and outcomes; for a commodity, cost. An example structure:

Category	KPI	Weight
Quality	PPM defects	30%
Delivery	OTIF	30%
Cost	Invoice first-pass match	10%
Service	Responsiveness (user survey)	15%
Risk & sustainability	Certificates current; emissions data provided	15%

The weighted total is useful for trends and comparisons, but do not let it hide a critical failure. Many organisations add "knock-out" rules: a safety incident or a lapsed mandatory certificate triggers action regardless of the overall score.

Segment before you measure

Measuring every supplier monthly is neither possible nor useful. Segment suppliers by spend and criticality (the Kraljic matrix is one way to do this) and apply effort accordingly: a full scorecard with quarterly business reviews for strategic and bottleneck suppliers, a light automated scorecard from system data for leverage suppliers, and exception reporting only for the long tail.

Using the scorecard

Business reviews

The scorecard is the agenda for a periodic review with the supplier, often quarterly for key suppliers. A productive review looks at trends rather than single data points, agrees root causes and actions with owners and dates, and also asks what the buyer could do better: late forecasts, specification changes and slow payment all hurt supplier performance.

Two-way feedback

Some organisations invite suppliers to rate them as a customer. It surfaces issues (unclear requirements, payment delays) that undermine supplier performance and signals that the relationship is a partnership.

Consequences

Scores should lead somewhere: preferred status and more business for top performers, a formal improvement plan for underperformers, and, after a reasonable period without improvement, re-sourcing. If scores never change a decision, suppliers will stop paying attention to them.

Practical tips

Automate data collection from ERP and quality systems wherever possible; manual scorecards decay.
Keep the subjective part small and structured, with defined descriptions for each score.
Publish the scorecard to the supplier on a fixed schedule and give them a chance to challenge data before it is final.
Review the KPI set once a year: indicators that are always green may no longer need tracking.