REF-1651 · Jeffries et al., 2020 · International Journal of Sports Physiology and Performance, · Paper · PubMed

The single-item self-report ratings most used in sport science to monitor training responses have not been validated: in a COSMIN review, 46.1% of the athlete-reported measures in 310 monitoring studies were single items, and apart from 2 studies of reliability and responsiveness no validity study of a single item was found; multi-item questionnaires were mostly adequate, except for content validity and measurement error

Main caveat: The abstract gives the appraisal in outline only: no list of instruments, no per-study ratings, no populations.
moderate evidenceMeasured on a mixed groupRead from the abstract only

Jeffries and colleagues noted that athlete-reported outcome measures are used widely in research and practice, yet their psychometric properties had not been examined.

In part 1 they identified the measures most often used in sport to monitor training responses: of 9446 articles screened by title and abstract, 310 of 334 full texts were included, and 53.9% of the measures had several items while 46.1% were single items.

In part 2 they screened 1895 articles, selected 71, and rated methodological quality, measurement properties and level of evidence with COSMIN. Most measurement properties of the multi-item questionnaires were adequate, but content validity and measurement error were not. Apart from 2 studies of reliability and responsiveness, no validity study of a single item was found.

The authors conclude that the single items most used in sport science are unvalidated, that unvalidated modified versions of those items are common, that conclusions based on them are "questionable" until proper validation is done, and that clinimetric reference methods should be used to develop and test such measures.

Participants

Studies of athletes using self-reported measures to monitor training responses; the number of athletes, their sports and levels are not in the abstract.

Methods

Part 1 (use): 9446 records screened by title and abstract; 334 full texts read, 310 included.
Part 2 (quality): 1895 records screened; 71 studies selected.
Appraisal: COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) checklist and criteria for methodological quality (risk of bias), quality of each measurement property and level of evidence.
Databases, search dates and the list of instruments: not in the abstract.

Key Results

Part 1: which measures are usedPart 2: how good is the evidence
Screened94461895
Included310 of 334 full texts71
Finding53.9% multi-item, 46.1% single-itemmulti-item: most properties adequate; content validity and measurement error inadequate. Single-item: no validity studies; 2 studies on reliability and responsiveness
Modified versions of the original, already unvalidated single items, themselves unvalidated, are common.
Authors' conclusion: conclusions drawn from these single-item measures are "questionable" until they are validated.

Practical Application

Read a single wellness rating as a prompt to ask, not as a measurement. The single items most used in sport science have no validity studies; inference, not tested here: a fall in one rating says the athlete feels different, not by how much or why, and the conversation that follows carries the information.
Multi-item questionnaires stand on firmer ground, with a gap. Most of their measurement properties were adequate, but content validity and measurement error were not; inference, not tested here: without a known measurement error, the size of a real change on these questionnaires is not established, so read a run of days, not one score.
Keep the check-in's wording and scale the same over time. Modified versions of unvalidated items were common; Inference, not tested here: rewording an item or changing its scale makes a new, untested measure and breaks comparison with the athlete's own history.
Not settled by this design / not from this paper: whether single items track training load or predict performance (the base's review of self-report measures is REF-368); which items or scales are best; anything specific to endurance athletes.

Limitations

The abstract gives the appraisal in outline only: no list of instruments, no per-study ratings, no populations.
The review rates measurement evidence; an unvalidated item can still be useful in practice, which this design does not test.
Search sources and dates are not in the abstract.
Written from the abstract and the PubMed record; full text not read.
How this entry was checked and changed
Why this level

a systematic review of measurement-property studies, not of controlled trials, so below the A rows, as with the other COSMIN reviews in the base; the abstract reports the COSMIN appraisal in outline (multi-item measures mostly adequate, single items without validity studies) but not per-study ratings

Content correction 2026-11-07
2026-11-07: added from the abstract and the PubMed record; level B+ (systematic review of measurement-property studies with COSMIN appraisal; abstract only).