REF-430 · Atkinson & Batterham, 2015 · Experimental Physiology, Vol. · Paper

True and false interindividual differences in the physiological response to an intervention

Methodological foundation for analyzing individual response variance

B+moderate evidenceMeasured on a mixed groupWritten before October 2026, being re-checked

Core Contribution

Shows that within-subject random variation — inevitable even with gold-standard measurement — is sometimes large enough to explain ALL apparent individual differences in response to an intervention.

True individual response differences are quantified only by comparing the SD of changes in the intervention arm with the SD of changes in a comparator arm (or from a prior repeatability study in the same population over the same duration). The difference between these SDs is what later literature calls the SD of individual responses (SDIR).

Key Findings (insight)

Most "individual response" papers conflate true biological variance with measurement error and regression to the mean. Popular plots of individual change scores are contaminated by random within-subject variation.

Using a simulated blood-pressure data set, the authors show that large individual differences in response can be suggested by such plots and analyses even when the true response is exactly the same in every individual.

If the SDs of change are similar in the intervention and comparator arms, true individual differences are clinically unimportant and any further "responder" analysis is unwarranted.

Method

Requires a comparator arm/condition — or a prior relevant repeatability study — to estimate the SD of changes that occurs without the intervention
The key statistic: SD of changes in the intervention arm compared with the same SD in the comparator arm (or from the repeatability study)
The paper's formula: SD_R = √(SD_I² − SD_C²), the SD of true individual responses (SDIR in later literature), where SD_I and SD_C are the SDs of the pre/post change scores in the intervention and comparator arms; the paper credits it to Hopkins et al. 2009 (preprint full text, checked 2026-09-28)
If the SDs are similar → no true interindividual differences worth exploring
Only if the difference between the SDs is clinically relevant is it logical to look for moderators or mediators of the individual response

Critical Implications

1

Many published responder-classification studies are methodologically inadequate — to date very few researchers have compared these SDs before making claims about individual differences

2

Single pre-post measurement comparisons without a comparator are insufficient

3

A "responder" label needs to be shown to exceed what measurement noise and regression to the mean would produce

Practical Application

Random within-subject variation can explain all of the apparent "responders" and "non-responders" in a training study; true individual differences exist only when the SD of changes in the trained group clearly exceeds that of a comparator group — treat any responder/non-responder label that lacks this comparison as unproven
Not from this paper; the base's own practice: before calling a protocol "works for this athlete", require a change comfortably larger than the test-retest noise of the measurement, ideally confirmed on repeated testing
For researchers: any responder classification needs a comparator arm (or a repeatability study in the same population over the same duration)
For individual athletes: a single before/after test cannot separate a real response from day-to-day variation; repeated testing and a known repeatability figure are the minimum

Limitations

Methodological paper with a simulated data set, not empirical training data
The comparator-SD approach requires control or repeatability data not always available
Does not address how to handle very small samples
How this entry was checked and changed
Why this level

regraded 2026-09-27 from A: narrative methodological review (with a simulated data set) from the leading group on this question; no systematic method

Content correction 2026-09-27
"Introduced SDIR" -> the abstract describes comparing SDs of change between intervention and comparator arms; the SDIR formula is kept but labelled "(full text; not checked against the abstract)".
"Repeated baseline testing (≥3 sessions)", "assume 5-8% CV", "effect >2× CV", "≥3 lab tests", "n<10" -> not in the abstract; removed or relabelled as the base's own practice.
Added the abstract's simulated blood-pressure demonstration and the regression-to-the-mean point.
Level A -> B+ (narrative methodological review from the leading group); added Tier/Sport lines. Cross-ref to REF-429 reworded: HERITAGE was single-arm, it did not "apply" this method.
2026-09-28: lines labelled "full text; not checked" read against the open-access full text (research.tees.ac.uk, author manuscript): 1 confirmed, 0 corrected, 0 removed. Formula confirmed; the paper names it SD_R and credits Hopkins et al. 2009.
2026-10-01: cross-reference to SYNTH-13 no longer names an archetype — that model was retired as an unvalidated composite.