Skip to content

Sampling design review checklist

A sampling audit follows the path from the population claim to the records used in the estimate.

On this page

Define the target and units

Write the population, reference period and quantity to estimate. Check whether a row is a case, a person, a transaction or a repeated update. Identify any changes in population definition during the research.

Reconstruct the selection procedure

Design audit questions
LayerCheck
FrameCoverage, duplicates and date
RandomizationPossible samples and selection probabilities
GroupsStrata or cluster stages and allocations
ResponseSelected, responding and usable counts
EstimatorPopulation weights and target units
UncertaintyDependence and variance convention

Perform an independent small check

When possible, enumerate a tiny fictional version of the design. Unit probabilities should reconcile with the expected sample count. Weights should match the intended target and sum as required. A full-population simple random sample should have zero subset-selection variance.

Review the conclusion’s scope

An estimate may be precise within the covered population while failing to cover an omitted group. A random selection procedure does not establish causality, and a count of thirty does not establish normality. Report the assumptions and remaining limitations next to the result.

Continue with CFA learning resources

Further references