PSLE Science Reality Lab Vol No.136 | “The Laboratory Passed a Proficiency Test” — Does That Guarantee Every Future Result Will Be Right?

PSLE-SCI-REALITY-0136

Wait, What? A Laboratory Can Pass a Test and Still Need to Keep Checking Itself Tomorrow

A laboratory website displays a badge: “Passed proficiency testing.” Below it, a confident sentence says, “Our results are guaranteed accurate.”

The first statement may describe real evidence. The second can travel much farther than that evidence allows.

In a proficiency test, a laboratory is given a sample or measurement task whose expected or assigned value can be compared with the laboratory’s result. The exercise helps evaluate how well the laboratory performs for that particular kind of measurement under defined conditions. A good result is useful evidence of competence at that time and for that tested job. It is not a scientific force field that makes every future sample, instrument, operator, concentration and method automatically correct.

The Reality Lab habit is to ask: what exactly was tested, when was it tested, and how far can that evidence reasonably travel?

Quick Answer

Identify the exact measurement covered by the proficiency test.
Ask what kind of sample or test item was used.
Check when the exercise took place and whether performance is monitored repeatedly.
Distinguish a successful comparison from a guarantee of every later result.
Look for continuing quality-control evidence, calibration, method checks and suitable scope.
Keep the conclusion narrow: the laboratory demonstrated acceptable performance in the tested exercise, not perfection forever.

The Exact Learner Job This Page Owns

This page owns one real-world evidence-transfer job: evaluating a scientific claim that turns success in a laboratory proficiency test into a universal guarantee about future measurements.

It does not replace the canonical owners of accuracy, precision, controls, calibration, uncertainty or accreditation. Reality Lab applies those ideas to a particular communication object: an inter-laboratory or reference-value performance result being used in an advertisement, laboratory profile, report or infographic.

Original Reality Lab Case: The Mystery Water Sample

This is an original composite teaching case. The laboratory, sample and values are fictional.

Four laboratories receive the same prepared water sample. Each is asked to measure fictional Substance M. The organiser has an assigned value of 40 units for the test item.

Laboratory	Reported result	Exercise interpretation
A	40.8 units	Acceptable for this exercise
B	39.4 units	Acceptable for this exercise
C	46.5 units	Needs investigation
D	40.1 units	Acceptable for this exercise

Laboratory A later advertises: “Passed proficiency testing. Every result we issue is guaranteed correct.”

The proficiency result supports a narrower statement: Laboratory A measured this test item acceptably under the exercise conditions. It does not establish that the laboratory will never make a mistake, that every method it offers is equally strong, or that every future unknown sample behaves like the test sample.

Observed, Demonstrated and Claimed

Layer	Statement
Observed	The laboratory returned a measurement for a specified proficiency-test item.
Compared	The result was evaluated against an assigned value or suitable comparison scheme.
Demonstrated	Performance was acceptable for the measurement covered by that exercise.
Overclaim	Every future result from the laboratory must be correct.
Hidden assumption	Future samples, instruments, methods, staff, concentrations and conditions will behave exactly like the proficiency exercise.

What Proficiency Testing Is Really Checking

NIST describes proficiency testing as a way to assess aspects of laboratory performance through comparison against reference values or other participants. In programmes such as NIST’s radiochemistry intercomparison work, laboratories measure test samples and compare their results with NIST reference values. The aim is to evaluate performance, identify problems and support improvement.

That last phrase matters: support improvement. A proficiency test is useful partly because a laboratory can learn from a poor result. It is not merely a trophy system in which “pass” means flawless forever and “fail” means permanently incompetent.

The Scope Check: Passed for Which Measurement?

A large laboratory may perform many different tests. One proficiency exercise may cover a particular measurand, range, method or sample type. Success there does not automatically prove equivalent performance for every other service.

Imagine a school laboratory that measures temperature very well. That does not tell you how well it measures tiny masses, light intensity or dissolved substances. The same reasoning applies to professional laboratories at much greater precision.

A careful reader therefore asks: does the proficiency test match the scientific job behind the public claim?

The Sample-Matrix Check: Was the Test Item Similar to the Real Samples?

A clean prepared water sample may be easier to analyse than muddy water, soil, food, plant tissue or industrial material. Other substances in a sample can affect extraction, preparation or instrument response. The surrounding material is often called the sample matrix.

Passing on one type of test item can be meaningful evidence, but it does not erase every matrix effect in future samples. If the public claim concerns a much more complicated material, the match between the proficiency item and real work becomes important.

The Time Check: Performance Is Not Frozen Forever

Suppose a laboratory passed an exercise three years ago. Since then it has replaced an instrument, trained new staff and changed a preparation procedure. The old result remains historical evidence about what happened then. It cannot by itself prove current performance.

This is why quality systems rely on continuing monitoring rather than one permanent victory. Instruments drift. Reagents age. procedures change. People make errors. New sample types create new challenges. Repeated proficiency testing and internal quality checks help reveal whether performance remains acceptable.

The Representation Check: What Does a “PASS” Badge Hide?

A website badge can compress an entire proficiency exercise into one word. Before treating the badge as scientific evidence, reconstruct what it summarizes:

Who organised the proficiency test?
What measurand was tested?
What sample type was used?
What method or range was involved?
When did the test occur?
What criterion counted as acceptable?
Was this one exercise or part of continuing performance monitoring?

The badge may be perfectly legitimate. The scientific error happens when readers make it support more than the underlying evidence.

The Comparison Check: Did Everyone Measure the Same Thing?

Proficiency testing is strongest when participants are compared on a clearly defined measurement. If one laboratory reports total Substance M and another reports only one chemical form, their numbers may not be directly comparable even if the units look similar.

Similarly, one method may have a different detection range or uncertainty. A fair comparison requires a common scientific object, not merely numbers placed in the same table.

What a Good Proficiency Result Strengthens

Confidence that the laboratory could measure the specified test item acceptably in that exercise.
Evidence that its measurement process was functioning suitably for that tested job at that time.
Evidence that its result was reasonably consistent with the assigned value or comparison scheme.
Evidence useful for monitoring laboratory performance over time when exercises are repeated.

What It Does Not Automatically Establish

That every other method in the laboratory has equal performance.
That every future unknown sample will be measured correctly.
That no human, instrument or transcription error can occur.
That a result is representative of an entire environment or product batch.
That the laboratory’s scientific interpretation or headline is correct merely because the numerical measurement passed a proficiency exercise.

Accreditation and Proficiency Testing Are Related but Not Identical

Accreditation is a broader formal recognition of competence for a defined scope. Proficiency testing can be one source of evidence used within quality and accreditation systems. But neither label should be stretched into “everything this laboratory ever reports is guaranteed true”.

NIST’s accreditation information explicitly notes that accreditation does not constitute a guarantee of laboratory performance or of test and calibration data. That boundary is exactly the Reality Lab habit: authority can strengthen evidence without turning uncertainty into zero.

Alternative Explanation 1: The Proficiency Item Was Easier Than the Real Sample

A laboratory passes on a clean water sample but later analyses muddy sediment. A poor sediment result would not contradict the fact that it passed the water exercise. The two evidence objects may test different difficulty and matrix conditions.

Alternative Explanation 2: Something Changed After the Test

An instrument component is replaced after the proficiency exercise and the new configuration is not checked correctly. The past proficiency result cannot see into the future. Current quality checks are needed.

Alternative Explanation 3: The Laboratory Measurement Is Fine but the Sampling Is Weak

A laboratory can measure a bottle accurately while the bottle was collected from an unrepresentative location. Proficiency testing evaluates laboratory performance for a defined task; it does not automatically repair a weak field-sampling design.

Alternative Explanation 4: A Single Future Result Contains a One-Off Error

Even a strong laboratory can experience a label swap, transcription mistake or unusual interference. Quality systems use multiple checks because one historical performance result cannot detect every future event.

What Evidence Would Strengthen a Laboratory’s Claim?

Recent proficiency testing covering the same measurement and relevant sample type.
Repeated acceptable performance over time rather than one isolated exercise.
Clear accreditation or competence scope where applicable.
Ongoing calibration, blanks, duplicates, reference checks and other appropriate quality controls.
Transparent handling of proficiency-test failures and corrective actions.
Measurement uncertainty suitable for the decisions being made.
Methods validated for the actual sample matrix, concentration range and purpose.

What Would Weaken It?

The laboratory advertises a pass but does not say what was tested.
The proficiency exercise is old while instruments or methods have changed.
The exercise covered a different sample type from the real work.
Only successful exercises are shown while failures and corrective actions are hidden.
The pass is used as proof of sampling representativeness or scientific causation.
The public wording promises perfect accuracy or zero uncertainty.

Worked Case 1: Same Method, New Concentration Range

A laboratory passes a proficiency exercise near 40 units. A future sample is 4,000 units and must be diluted heavily before measurement. The old pass remains useful evidence about the method, but the extreme new range introduces additional steps and possible sources of error. The laboratory needs evidence that its procedure performs correctly there too.

Worked Case 2: Repeated Passes Over Several Years

A laboratory participates in similar proficiency tests every year and repeatedly obtains acceptable results. This is stronger evidence of stable performance than one old pass. It still does not make every individual future result guaranteed. Repeated evidence increases confidence; it does not abolish uncertainty.

Worked Case 3: A Failed Exercise Followed by Repair

A laboratory reports a poor proficiency result, investigates and discovers a preparation error. It corrects the procedure, trains staff and later demonstrates acceptable performance. Should the earlier failure be treated only as shame? No. Properly investigated, it becomes diagnostic evidence that improves the measurement system.

Worked Case 4: A Passed Measurement, Overstated Headline

A laboratory competently measures Substance M in five product samples. The company headline says, “Scientifically proven safe for everyone.” Proficiency evidence can support confidence in the measurement process. It cannot by itself establish the much broader health or safety claim.

Tempting Reasoning That Fails

“Passed once means perfect forever.” Performance must be maintained and monitored.
“Failed once means the laboratory is permanently bad.” A proficiency failure can reveal a correctable weakness.
“All proficiency tests are equivalent.” Scope, test item, measurand and organiser matter.
“Accredited plus PT pass means zero uncertainty.” Competence evidence does not remove measurement uncertainty.
“If the lab is good, the sample must be representative.” Laboratory quality and sampling representativeness are different scientific jobs.

Model and Measurement Limits

Proficiency-testing schemes vary. Some compare results with a well-characterised reference value. Others compare participant results statistically. Acceptance criteria differ by measurement field, purpose and programme. Reality Lab therefore does not invent a universal pass percentage or score.

The durable reasoning pattern is more useful: identify the tested job, locate the comparison basis, inspect the result, then keep claims inside the scope of what was actually demonstrated.

How Far Can the Conclusion Travel?

A recent, well-designed proficiency result can support a statement such as: “The laboratory demonstrated acceptable performance for this measurement in this proficiency exercise.” Repeated exercises and supporting quality evidence can justify greater confidence in continuing competence.

The conclusion should not silently become: “Every result from this laboratory is guaranteed right.” That extra distance requires evidence no proficiency test can provide.

PSLE-Style Transfer Case

Laboratory X measures a standard sample whose accepted value is 25 units. It reports 25.4 units and the result is accepted in a proficiency exercise. Six months later the laboratory measures a completely different thick paste with the same instrument.

Question: Why can the proficiency-test result not guarantee that the paste result is correct?

Reasoned answer: The proficiency test showed acceptable performance for a particular test item and measurement conditions. The paste may have a different sample matrix and preparation process, and laboratory performance can change over time. Additional method and quality evidence is needed for the new sample.

Explained Practice

Practice A: A laboratory passed a proficiency test yesterday for Substance A in drinking water. Does that prove it can measure Substance B in soil? No. The tested measurand and matrix differ.

Practice B: A laboratory fails one round but later identifies and corrects an instrument problem. What evidence matters next? Documentation of the corrective action plus new quality and proficiency evidence showing the repair worked.

Practice C: A company says, “The laboratory passed PT, therefore our product claim is scientifically proven.” What must you separate? Measurement competence from the separate question of whether the experiment and interpretation support the product claim.

Delayed Independent Return: The P-R-O-V-E Check

P — Proficiency item: What exactly did the laboratory measure?
R — Reference: What was the result compared with?
O — Occasion: When did the exercise happen?
V — Valid scope: Which method, range and sample type does it support?
E — Evidence now: What continuing quality evidence supports today’s result?

Parent and Tutor Teaching Guide

Use a simple analogy carefully. A pupil who solves one difficult fractions test well has evidence of competence on that test. It would still be too strong to say the pupil can never make another fractions error, or must therefore be equally strong at geometry. Ask the learner where the analogy stops: scientific proficiency testing is more controlled and technical, but the idea of scope remains useful.

Then give three fictional badges: “Passed PT for temperature”, “Passed PT for Substance Q in water”, and “Accredited laboratory”. Ask the learner to match each badge to claims it can support and claims it cannot. The goal is to make evidence boundaries visible without teaching cynicism about laboratories.

Authoritative Sources

The official Singapore Science frame fits this advanced evidence object well. Learners are expected to interpret and analyse information, evaluate observations, information and methods, and communicate reasoning. A proficiency-test badge is not an examiner trick. It is a real-world example of why good science asks what evidence supports, what it does not support and what needs to be checked again.

The Quiet Return

A proficiency test is valuable because it gives a laboratory an evidence checkpoint.

It is not a lifetime promise.

When a laboratory says it passed, ask the scientific question behind the badge: passed what, under which conditions, and what evidence shows the performance still holds now?

Small Group Tutorials