Laboratory Mathematics
Laboratory Mathematics and Diagnostic Performance
On this page
Interpret a laboratory result together with its units, measured precision, dilution convention, and comparison population. Carry full precision through intermediate steps, confirm that the units cancel correctly, and round only the final value according to the measurement procedure or reporting rule.
Quantities, precision, and rounding
Significant figures indicate the precision of a measured value. Measured quantities limit the precision of a calculation; exact counts and defined conversion factors do not.
| Zero position | Rule | Example |
|---|---|---|
| Between nonzero digits | Significant | 4,050,726 has seven significant figures |
| At the end of a value with a decimal point | Significant | 5400.0 has five significant figures |
| Before the first nonzero digit | Sets decimal position | 0.00471 has three significant figures |
| At the end of a decimal fraction | Significant when written | 0.00470 has three significant figures |
For addition or subtraction, report the result to the least precise decimal place among the measured values. For multiplication or division, report the result with as many significant figures as the measured value that has the fewest.1
9.7 mL + 2.84 mL + 0.316 mL = 12.856 mL, reported as 12.9 mL because 9.7 mL reaches the tenths place.6.2 mg/mL × 3.45 mL = 21.39 mg, reported as 21 mg because 6.2 has two significant figures.
Round only after the calculation is complete. Leave the retained digit unchanged when the first discarded digit is below 5. Increase it by one when the first discarded digit is above 5, or when a 5 is followed by any nonzero digit. If the discarded portion is exactly 5 followed only by zeros, choose the adjacent value with an even final digit: 4.85 → 4.8 and 3.75 → 3.8 at two significant figures. Scientific notation makes the intended precision of trailing zeros clear, as in 3.65 × 103 mg/dL.
A proportion states that two ratios are equal. Match the units before cross-multiplying and solving for the unknown. A reagent formula contains 2.00 g per 100.0 mL, so 2.00 g/100.0 mL = x g/300.0 mL. Cross-multiplication gives 100.0x = 600.0, or x = 6.00 g. Writing the unit beside each number makes an inverted conversion or mismatched volume easier to spot before the arithmetic begins.
Dilutions, serial dilutions, and titers
A dilution contains a measured volume of sample and a diluent. Because ratio notation differs among methods, the denominator must be defined.2,3
| Written convention | Composition | Dilution factor |
|---|---|---|
1-in-10 total, or a 1:10 dilution under this site’s clinical chemistry convention | 1 part sample + 9 parts diluent | 10 |
1 + 10 | 1 part sample + 10 parts diluent | 11 |
1:10 sample:diluent | 1 part sample + 10 parts diluent | 11 |
Dilution fraction = sample volume ÷ final volume
Dilution factor = final volume ÷ sample volume
In a 1-in-8 dilution with a final volume of 320 µL, each part is 320 ÷ 8 = 40 µL. Prepare it with 40 µL sample and 280 µL diluent.
Correct the diluted specimen result with the factor that matches the prepared sample and diluent volumes:
Original concentration = diluted result × dilution factor
Mixing 25 µL serum with 225 µL diluent gives 250 µL total and a dilution factor of 10. A diluted triglyceride result of 365 mg/dL corresponds to 365 × 10 = 3.65 × 103 mg/dL in the original specimen. For patient testing, use a diluent, ratio, and measuring interval supported by the manufacturer or validated by the laboratory. The Dilution Math and Dilution Bench pages provide more practice with preparation and correction.
For a serial dilution, multiply the factor from every completed step. Three successive 1-in-5 dilutions produce a cumulative dilution of 1/5 × 1/5 × 1/5 = 1/125 and a cumulative factor of 125. Using 10 µL transferred sample and 40 µL fresh diluent at each step consumes 10 µL of original specimen and 120 µL of fresh diluent across the series. A 1-in-15 step followed by four twofold steps gives a cumulative factor of 15 × 24 = 240, or a 1-in-240 total dilution.
A titer is the reciprocal of the highest tested dilution that meets the assay’s defined positive endpoint. In a twofold series from 1/2 through 1/512, an endpoint present through 1/64 and absent from 1/128 onward gives a reported titer of 64. The assay procedure defines the endpoint, reaction conditions, and reporting form.
Molarity, normality, and percent solutions
Molarity and normality appear in the examination outline and in many laboratory instructions. The SI unit for amount-of-substance concentration is mol/m³, although clinical laboratories commonly use mol/L. Normality is a reaction-specific legacy convention expressed in eq/L.1
Molarity
Calculate amount in moles from mass and molar mass:
Amount (mol) = mass (g) ÷ molar mass (g/mol)
Amount concentration (mol/L) = amount (mol) ÷ final solution volume (L)
The traditional symbol M denotes mol/L, as in 1.25 M. To prepare 600 mL of 1.25 mol/L NaOH with a molar mass of 40.00 g/mol:
Mass = 1.25 mol/L × 0.600 L × 40.00 g/mol = 30.0 g NaOH
Dissolve the measured solute and bring the solution to its stated final volume.
Normality
Normality is expressed in equivalents per liter and depends on the reaction being described. The n-factor counts the protons, hydroxide ions, electrons, or charge units that participate in that reaction.2
Equivalent mass (g/eq) = molar mass (g/mol) ÷ reaction-specific n-factor (eq/mol)
Normality (eq/L) = mass (g) ÷ [equivalent mass (g/eq) × solution volume (L)]
Normality = n-factor × molarity
For complete neutralization of both protons in H2SO4, the n-factor is 2. Its equivalent mass is 98.08 ÷ 2 = 49.04 g/eq. Calculate the amount needed to prepare 850 mL of 2.40 N H2SO4:
2.40 eq/L × 0.850 L × 49.04 g/eq = 1.00 × 102 g H2SO4
The n-factor depends on the stated reaction:
| Substance and stated reaction | n-factor | Relationship |
|---|---|---|
| H3PO4 with all three protons reacting | 3 | 0.500 M = 1.50 N |
| H3PO4 with one proton reacting | 1 | 0.500 M = 0.500 N |
| CaCl2 with Ca2+ supplying two charge equivalents | 2 | 3.00 M = 6.00 N |
Percent solutions
Percent notation defines the numerator and the final quantity of solution.2
| Form | General calculation | Meaning of 3.2% |
|---|---|---|
| Weight/weight, % w/w | mass solute ÷ mass final solution × 100% | 3.2 g solute per 100 g solution |
| Weight/volume, % w/v | mass solute in g ÷ final solution volume in mL × 100% | 3.2 g solute per 100 mL solution |
| Volume/volume, % v/v | solute volume ÷ final solution volume × 100% | 3.2 mL solute per 100 mL solution |
A 3.2% w/v NaCl solution has 3.2 g per 100 mL. For 250 mL, 3.2 × 2.5 = 8.0 g NaCl.
To convert a percentage to amount concentration, first express it per liter. A 0.850% w/v NaCl solution contains 8.50 g/L. Using a molar mass of 58.44 g/mol gives 8.50 ÷ 58.44 = 0.145 mol/L. A 5.00% w/v H2SO4 solution contains 50.0 g/L; dividing by the reaction-specific equivalent mass of 49.04 g/eq gives 1.02 N for complete neutralization of both protons.
Hydrated salts and concentrated stocks
The formula of a hydrate includes a fixed number of water molecules. Use the ratio of molar masses to adjust the required mass:
Mass of hydrate = required anhydrous mass × (molar mass of hydrate ÷ molar mass of anhydrous salt)
To replace 12.0 g of anhydrous MgSO4 with MgSO4·7H2O, calculate 12.0 × (246.5 ÷ 120.36) = 24.6 g MgSO4·7H2O.
Concentrated-reagent calculations use the reagent assay as a mass fraction and the solution density. Specific gravity is a dimensionless relative-density ratio. Its numerical use depends on the stated reference temperature and water density.4 For an examination problem that gives HCl a specific gravity of 1.18, treats that value as 1.18 g solution/mL, and states 36.0% w/w HCl:
Pure HCl per mL = 1.18 g/mL × 0.360 = 0.4248 g/mL
Stock concentration = 424.8 g/L ÷ 36.46 g/mol = 11.65 mol/L, approximately 11.7 M
When stock and working concentrations use matching units, apply C1V1 = C2V2. To prepare 750.0 mL of 0.800 M HCl from this approximate stock:
V1 = (0.800 M × 750.0 mL) ÷ 11.7 M = 51.3 mL
For an actual reagent, follow the current label, certificate, safety data sheet, and laboratory procedure. When diluting concentrated acid with water, add the acid slowly to the water while using the required ventilation and protective equipment.5
Mass and amount unit conversions
Use molar mass to convert between mass concentration and amount concentration. To convert mg/dL to mg/L, multiply by 10:
mmol/L = mg/L ÷ molar mass in mg/mmol
For a specified ion:
mEq/L = mmol/L × absolute ionic charge
A magnesium result of 2.10 mg/dL equals 21.0 mg/L. Using a molar mass of 24.305 mg/mmol gives 21.0 ÷ 24.305 = 0.864 mmol/L; multiplying by the Mg2+ charge gives 1.73 mEq/L.
A glucose result of 108 mg/dL equals 1,080 mg/L. Using a molar mass of 180.16 mg/mmol gives 1,080 ÷ 180.16 = 5.99 mmol/L. The laboratory’s validated reporting unit and conversion factor govern patient results.
Standard curves
An ideal blank-corrected solution with one absorbing species follows the Beer-Lambert relationship:6
A = εbc
In this equation, A is absorbance, ε is the molar absorption coefficient, b is path length, and c is the amount concentration. With path length in centimeters and concentration in mol/L, ε is commonly expressed in L·mol−1·cm−1.
A standard curve plots signals from known calibrators and applies the accepted calibration model to determine an unknown concentration. An ideal blank-corrected Beer-Lambert line passes through the origin, but an empirical calibration may have an intercept or use a validated nonlinear fit. The measurement procedure defines the model and calibration interval.7
Verify the stated interval with multiple calibrators or verification materials that span low, middle, and high levels and bracket clinically important concentrations. A single point provides evidence only at its concentration.
A validated linear calibration has the equation A = 0.00250C + 0.005, where C is concentration in mg/dL. An unknown has A = 0.305:
C = (0.305 − 0.005) ÷ 0.00250 = 1.20 × 102 mg/dL
Instrument bandpass, stray light, high concentration, turbidity, and shifts in chemical equilibrium can cause the response to depart from the ideal relationship. Many absorbance systems lose useful relative precision as absorbance approaches about 2, but the method’s established interval sets the actual limit. Interpolate only within the validated calibration and measuring intervals. When a result exceeds the highest calibrator or upper measuring limit, follow the validated dilution and reanalysis procedure. If no validated dilution is available, use the procedure’s supported limit-form report, such as > upper limit.3,7 The Core Chemistry Calculations page covers absorbance and percent-transmittance arithmetic.
Central tendency, control limits, and confidence intervals
Mean, median, and mode are different measures of a data set’s location.8
| Measure | Calculation | Main feature |
|---|---|---|
| Mean | Sum of values ÷ number of values | Uses every magnitude and moves with extreme values |
| Median | Middle ranked value; average the two middle values when the count is even | Uses rank and is less affected by extremes |
| Mode | Most frequent value | Can be absent or have more than one value |
Consider six chloride results: 107, 102, 110, 105, 108, and 104 mEq/L. In order, they are 102, 104, 105, 107, 108, and 110. Their mean is 636 ÷ 6 = 106 mEq/L, their median is (105 + 107) ÷ 2 = 106 mEq/L, and the set has no mode. In an ideal normal population, mean, median, and mode coincide. Close agreement among sample measures can be consistent with symmetry, but the shape of the distribution requires separate assessment.
Control limits indicate where individual control results are expected under a defined statistical-control procedure. When a hematocrit control range of 34% to 46% is explicitly defined as mean ±2 standard deviations (SD), its midpoint is 40%. The 12-percentage-point span equals 4 SD, so 1 SD is 3%. The ±1 SD interval is 37% to 43%, and the ±3 SD interval is 31% to 49%. Quality Control, Method Evaluation, and Quality Management applies these values to control charts.
A confidence interval quantifies uncertainty in an estimated population parameter. For a mean from an approximately normal population with unknown population SD, a two-sided 95% interval uses:9
95% confidence interval for the mean = sample mean ± t0.975,n−1 × (sample SD ÷ √n)
For these six chloride results, the sample SD is 2.8983 mEq/L, the standard error is 2.8983 ÷ √6 = 1.1832 mEq/L, and the two-sided 95% t critical value with 5 degrees of freedom is 2.571:
106 ± (2.571 × 1.1832) = 106 ± 3.042, or 103.0 to 109.0 mEq/L
Over many repeated samples, the 95% confidence level is the proportion of intervals from this method that would contain the population mean. With similar variability, a larger sample produces a narrower interval.
Diagnostic performance
Analytical sensitivity concerns a measurement procedure’s ability to detect low levels, while analytical specificity concerns its response to the intended measurand when other substances are present. Diagnostic sensitivity and diagnostic specificity instead compare classifications with a designated reference standard. The estimates apply to a defined target condition, threshold, population, specimen, and setting.2,10,11
| Reference standard: condition present | Reference standard: condition absent | |
|---|---|---|
| Test positive | True positive (TP) | False positive (FP) |
| Test negative | False negative (FN) | True negative (TN) |
Sensitivity = TP ÷ (TP + FN) × 100%
Specificity = TN ÷ (TN + FP) × 100%
Positive predictive value (PPV) = TP ÷ (TP + FP) × 100%
Negative predictive value (NPV) = TN ÷ (TN + FN) × 100%
In a hypothetical example, a high-sensitivity troponin cutoff is evaluated in 500 emergency-department patients against a designated reference standard. The results are TP = 150, FP = 10, FN = 8, and TN = 332.
| Measure | Calculation | Estimate |
|---|---|---|
| Sensitivity | 150 ÷ (150 + 8) × 100% | 94.9% |
| Specificity | 332 ÷ (332 + 10) × 100% | 97.1% |
| PPV | 150 ÷ (150 + 10) × 100% | 93.8% |
| NPV | 332 ÷ (332 + 8) × 100% | 97.6% |
| Cohort prevalence | (150 + 8) ÷ 500 × 100% | 31.6% |
Sensitivity and specificity are study estimates. Their transferability depends on the threshold, reference classification, participant spectrum, and study design. PPV and NPV also vary with prevalence and with how the study population was assembled. The predictive values above apply to this cohort, whose prevalence is 31.6%. A comparison with a routine method that is not a reference standard is reported as positive and negative percent agreement.10 The Preanalytic, Analytic, and Postanalytic Quality Assessment page applies sensitivity, specificity, and pretest probability through Bayes reasoning.
References
- Thompson A, Taylor BN. Guide for the Use of the International System of Units (SI). NIST Special Publication 811. National Institute of Standards and Technology; 2008. Updated February 19, 2025. Accessed August 30, 2026.
- Bishop ML, Fody EP, Van Siclen C, Mistler JM, Moy M. Clinical Chemistry: Principles, Techniques, and Correlations. 9th ed. Jones & Bartlett Learning; 2023.
- Clinical and Laboratory Standards Institute. Establishing and Verifying an Extended Measuring Interval Through Specimen Dilution and Spiking. 1st ed. CLSI guideline EP34. Clinical and Laboratory Standards Institute; 2018. Reaffirmed March 2023. Accessed August 30, 2026.
- National Institute of Standards and Technology. Specific gravity. Added June 12, 2023. Accessed August 30, 2026.
- National Institute for Occupational Safety and Health. Engineering Controls Database: acids and alkalis. Reviewed November 16, 2018. Accessed August 30, 2026.
- International Union of Pure and Applied Chemistry. Beer–Lambert law. In: Compendium of Chemical Terminology. 5th ed. International Union of Pure and Applied Chemistry; 2025. Online version 5.0.0. doi:10.1351/goldbook.B00626.
- Clinical and Laboratory Standards Institute. Evaluation of Linearity of Quantitative Measurement Procedures. 2nd ed. CLSI guideline EP06. Clinical and Laboratory Standards Institute; 2020. Accessed August 30, 2026.
- National Institute of Standards and Technology. Measures of location. NIST/SEMATECH e-Handbook of Statistical Methods. Accessed August 30, 2026.
- National Institute of Standards and Technology. Confidence limits for the mean. NIST/SEMATECH e-Handbook of Statistical Methods. Accessed August 30, 2026.
- US Food and Drug Administration. Statistical Guidance on Reporting Results from Studies Evaluating Diagnostic Tests: Guidance for Industry and FDA Staff. Issued March 13, 2007. Accessed August 30, 2026.
- Clinical and Laboratory Standards Institute. Evaluation of Qualitative, Binary Output Examination Performance. 3rd ed. CLSI guideline EP12. Clinical and Laboratory Standards Institute; 2023. Accessed August 30, 2026.