Skip to content
LatticeMLS, Home

Add your earlier progress to your account?

From before you signed in, this browser has:

Which plan do you want to keep?

You changed your plan before signing in, and those changes don't match the plan saved on your account.

SettingSaved planPlan changes

Study progress is waiting to be saved

How well a method performs

17 min

Skills you'll build3 skills
  • Calculate a sigma metric with compatible error, bias, and imprecision units
  • Tell method agreement from a high correlation coefficient
  • Test proficiency samples through the routine patient workflow

At the bench: Check method precision and agreement against acceptance limits

Try first

Try first

At one control concentration a method has a CV of 2.5% and a bias of −1.5%. The laboratory's allowable total error is 10%. What is the sigma metric?

Keep going to see the reasoning.

Keep going to see the reasoning.

Right. Keep going to follow the reasoning.

Keep going to see the reasoning.

Get the idea

Daily QC shows whether a method is in control today. Three other tools show whether the method meets its quality requirements and whether it agrees with other methods and laboratories.

The sigma metric

The sigma metric is the number of CVs that fit into the allowable total error remaining after bias:

sigma = (allowable total error % − |bias %|) ÷ CV %

  • Bias is taken as an absolute value, regardless of sign, because a method that reads 3% low uses as much of the allowable error as one that reads 3% high.1
  • All three numbers must be in the same form. Convert an SD to a CV with CV = SD ÷ mean × 100, and a bias in concentration units to a percent of the same mean, or keep all three in concentration units.
  • The metric applies to one concentration and one allowable error, and it is one input to choosing QC rules.

Interpret the metric this way:1

Sigma metricWhat it means for QC
Near 6Ample margin for error
Near 3Tighter QC rules, and more of them

Method agreement

Method agreement comes up when a laboratory compares a new method with the one it replaces. Paired patient specimens are run on both, and the correlation coefficient, r, is often the first number printed.

  • A high r shows only that the pairs fall close to a straight line.
  • Two methods can fall on a near-perfect line with one reading consistently higher. The value of r mainly shows whether the specimens covered a wide enough range to fit the line well.2
  • Agreement is judged from the bias at the concentrations where clinical decisions are made, compared with the bias the laboratory decided in advance it could accept.2,3

Proficiency testing

Proficiency testing (PT) sends blinded samples from an outside program, and the laboratory's answers are graded against a target or a peer group. PT assesses the laboratory's routine error, so the samples go through the routine workflow. Under CLIA they are tested:4

  • with the regular patient workload
  • by the people who usually run the test
  • with the usual method
  • the same number of times as a patient specimen

Laboratories must not:4

  • discuss PT results with each other before the reporting deadline
  • send PT samples to another laboratory for testing they are certified to do themselves

With special handling, the grade reflects that handling and misses the error in patient results.

Follow the bench demonstration

Sources for this step
References
  1. Westgard QC. Best practices for Westgard rules. Accessed September 23, 2026.
  2. Westgard JO. The comparison of methods experiment. Westgard QC. Accessed September 23, 2026.
  3. Clinical and Laboratory Standards Institute. Measurement Procedure Comparison and Bias Estimation Using Patient Samples. 3rd ed. CLSI guideline EP09c. Clinical and Laboratory Standards Institute; 2018. Accessed September 23, 2026.
  4. Electronic Code of Federal Regulations. 42 CFR §493.801: Condition: Enrollment and testing of samples. Accessed September 23, 2026.

Watch one

A cholesterol control has a mean of 200 mg/dL and an SD of 4.0 mg/dL.

  • A peer comparison shows the method reads 6 mg/dL low at that level.
  • The laboratory's allowable total error is 10%.

What is the sigma metric?

  1. Convert the SD to a CV: 4.0 ÷ 200 × 100 = 2.0%.

    Sigma requires imprecision as a percent when the allowable error is a percent.

  2. Express the bias as a percent of the mean: 6 ÷ 200 × 100 = 3.0%.

    Bias must be in the same form as the other two numbers.

  3. Take the absolute value of the bias, 3.0%, and ignore the sign.

    A low bias uses the allowable error just as a high one does.

  4. Calculate (10 − 3.0) ÷ 2.0 = 7.0 ÷ 2.0 = 3.5.

    The remaining allowable error divided by the CV gives the sigma metric.

  5. Check in mg/dL: the allowance is 20 mg/dL, and (20 − 6) ÷ 4.0 = 3.5.

    Working in concentration units must give the same answer if the units match.

The sigma metric is 3.5 at 200 mg/dL.

Practice this skill

Your turn

Problem 1 of 3 · Hints available

A procedure has CV 2%, bias −2%, and a laboratory-adopted allowable total error of 10%. What is its sigma metric at this concentration?

Correct. Use the magnitude of bias: (10 − 2) ÷ 2 = 4.

Incorrect. (10 − (−2)) ÷ 2 incorrectly treats negative bias as extra allowable error. Either bias direction consumes the allowance.

Incorrect. 10 − 2 gives the remaining allowance in percentage points. Divide it by CV 2% to obtain sigma 4.

Hint
  1. Bias in either direction uses up part of the allowable error.
  2. Use the size of the bias, 2%, and subtract it from 10%.
  3. Then divide what is left by the CV.

Review Sigma metric and matching units

Problem 2 of 3 · Hints available

A laboratory compares a new creatinine method with its current one on 40 patient specimens. The correlation coefficient is 0.998. Across the range, the new method reads about 0.3 mg/dL higher. Before the study the laboratory set an allowable bias of 0.1 mg/dL at 1.0 mg/dL. Can the new method replace the old one without further action?

An r of 0.998 shows the pairs lie close to a line. Results that run 0.3 mg/dL above the old method can still lie close to a line.

Called methods interchangeable because correlation was high

A correlation coefficient measures how closely paired results follow a line. In one calcium comparison, r = 0.9997 with a bias of +0.15 mg/dL at 10.5 mg/dL. Calling the methods interchangeable on r alone lets that bias reach patient results when the laboratory switches methods.

Agreement is judged from the bias at decision concentrations against the limit set in advance, and this bias is well beyond it.

Forty specimens with a consistent offset are enough to show the bias. More pairs would not remove a bias three times the allowed limit.

Hint
  1. Ask what r measures: closeness to a line, or closeness of the results.
  2. Compare the bias you see with the bias the laboratory decided it could accept.

Review Comparing a candidate method

Problem 3 of 3 · On your own

A chemistry PT event arrives on a busy Tuesday. Which way of handling the samples follows the rules?

That is the routine workflow, so the grade reflects the error in patient results.

Extra repeats and a hand-picked analyst are special handling. PT samples are tested the same number of times as patient specimens by the people who usually do the work.

Gave proficiency material a special workflow

Running PT samples in replicate, assigning them to the most experienced person, or checking with another laboratory means the result no longer shows routine performance. CLIA requires the routine personnel, method, and number of repeats. It forbids referral or interlaboratory communication before the deadline. Special handling risks CLIA sanctions and hides routine testing errors.

Talking with another laboratory about PT results before the reporting deadline is not allowed, even when the testing itself was routine.

Gave proficiency material a special workflow

Running PT samples in replicate, assigning them to the most experienced person, or checking with another laboratory means the result no longer shows routine performance. CLIA requires the routine personnel, method, and number of repeats. It forbids referral or interlaboratory communication before the deadline. Special handling risks CLIA sanctions and hides routine testing errors.

A PT sample must not go to another laboratory for testing the laboratory is certified to perform itself.

Review Proficiency testing and external quality assessment

Use it

Optional for this step.

  • The chemistry section is replacing its calcium method. Ten patient specimens were run on the current method (comparative) and the new one (candidate).
  • Before the study, the laboratory director set the acceptance criterion: a bias within ±0.12 mg/dL at 8.5 mg/dL and at 10.5 mg/dL.
  • The fitted line has r = 0.9997. It predicts a candidate result of 8.60 mg/dL where the comparative method reads 8.5 mg/dL, and 10.65 mg/dL where it reads 10.5 mg/dL.
Decision 1 of 2

The paired results, in mg/dL:

SpecimenComparativeCandidate
17.67.7
28.08.1
38.48.5
48.88.9
59.19.2
69.59.6
79.910.0
810.310.4
910.811.0
1011.211.4

What is the candidate-minus-comparator bias at the two decision concentrations?

8.60 − 8.5 = +0.10 mg/dL and 10.65 − 10.5 = +0.15 mg/dL. The candidate reads higher, and the difference increases with concentration.

These are comparator minus candidate, so the sign is reversed. The candidate reads higher than the current method.

+0.12 mg/dL is the mean of the ten paired differences. A single average hides a bias that increases with concentration, so bias is estimated at each decision concentration.

Review Comparing a candidate method

Decision 2 of 2

What is the next action for the candidate method?

An r of 0.9997 shows the pairs lie close to a line. The criterion is about bias, and the bias at 10.5 mg/dL exceeds it.

Called methods interchangeable because correlation was high

A correlation coefficient measures how closely paired results follow a line. In one calcium comparison, r = 0.9997 with a bias of +0.15 mg/dL at 10.5 mg/dL. Calling the methods interchangeable on r alone lets that bias reach patient results when the laboratory switches methods.

The criterion applies at both decision concentrations. At 10.5 mg/dL the bias is +0.15 mg/dL.

+0.15 mg/dL is beyond the ±0.12 mg/dL set before the study. The candidate reports no patient results until the cause is found and a new comparison meets the criterion.

The bias is +0.10 mg/dL at 8.5 mg/dL, so a fixed correction would give results 0.05 mg/dL low there. A correction changes the method and needs its own validation.

Review Comparing a candidate method

Only the bias at 10.5 mg/dL falls outside the acceptance criterion. The pairs fit a line closely. At the upper decision concentration the candidate reads 0.15 mg/dL high, beyond the limit set before the study.

For reference

Sources checked