Can I trust my ring or watch's overnight HRV?
As your own trend, mostly: Oura and WHOOP were off a chest strap by 6-8% on average, Garmin Fenix 6 and Polar Grit X Pro by 11-16%. Resting HR: about 1-2 bpm. 13 people.
Dial and colleagues asked how closely the overnight resting heart rate (RHR) and HRV (RMSSD) shown by five consumer wearables match a reference.
Thirteen healthy adults (7 men, 6 women) slept at home wearing a Polar H10 chest strap (recorded through a separate, unworn Polar watch) together with any of a Garmin Fenix 6, Oura Generation 3 and Generation 4 rings, a Polar Grit X Pro and a WHOOP 4.0 (one device per wrist), for 536 nights in all; participants with at least 10 nights were included.
The strap's RR intervals were processed in Kubios and averaged over the night (over the first 4 h for comparison with the Polar watch, which reports only that window). Resting heart rate agreed closely for the four devices compared: concordance 0.97 (Oura Gen 3), 0.98 (Gen 4), 0.91 (WHOOP) and 0.86 (Polar), MAPE 1.67-3.00%, mean absolute error 0.98-1.78 bpm.
Garmin was left out of the resting-heart-rate comparison because it reports the lowest 30-min average of the 24 h without saying when that was. HRV agreement differed more: Oura Gen 4 concordance 0.99 (MAPE 5.96%), Gen 3 0.97 (7.15%), WHOOP 0.94 (8.17%), Garmin 0.87 (10.52%) and Polar 0.82 (16.32%); Polar's HRV error was larger than every other device's.
Errors persisted when each night was expressed as a z-score against the person's own reference baseline, which the authors read as coming from the devices' processing rather than from differences between people.
Our reading: the most direct test the base has of the overnight numbers behind a readiness check-in — resting heart rate is trustworthy on all four devices compared, HRV is trustworthy to within about 6-8% on the Oura and WHOOP devices tested and less so on the Garmin and Polar watches tested — from 13 people, with reporting errors that limit what the Polar rows can be trusted for.
Protocol
Key Results
Resting heart rate (bpm) against the chest strap (Table 1):
| Oura Gen 3 | Oura Gen 4 | Polar Grit X Pro | WHOOP 4.0 | |
|---|---|---|---|---|
| Nights | 470 | 138 | 206 | 288 |
| Mean bias ± SD | −0.88 ± 1.00 | −0.94 ± 1.43 | −0.01 ± 2.13 | −1.41 ± 1.69 |
| Limits of agreement | −2.84 to 1.08 | −3.75 to 1.87 | −5.36 to 2.06 | −4.72 to 1.90 |
| Mean absolute error | 0.98 ± 0.90 | 1.08 ± 1.33 | 1.72 ± 1.30 | 1.78 ± 1.31 |
| MAPE | 1.67 ± 1.54% | 1.94 ± 2.51% | 2.71 ± 2.75% | 3.00 ± 2.15% |
| Concordance (CCC) | 0.97 | 0.98 | 0.86 | 0.91 |
HRV, RMSSD in ms (Table 3):
| Garmin Fenix 6 | Oura Gen 3 | Oura Gen 4 | Polar Grit X Pro | WHOOP 4.0 | |
|---|---|---|---|---|---|
| Nights | 150 | 470 | 139 | 206 | 289 |
| Mean bias ± SD | −1.84 ± 6.86 | −2.50 ± 4.56 | −0.96 ± 5.52 | −4.65 ± 9.67 | −0.78 ± 5.98 |
| Limits of agreement | −15.218 to 11.60 | −11.43 to 6.43 | −11.78 to 9.85 | −14.30 to 23.60 | −12.50 to 10.94 |
| Mean absolute error | 5.29 ± 4.72 | 3.91 ± 3.40 | 3.93 ± 3.98 | 7.27 ± 7.88 | 4.17 ± 4.33 |
| MAPE | 10.52 ± 8.63% | 7.15 ± 5.48% | 5.96 ± 5.12% | 16.32 ± 24.39% | 8.17 ± 10.49% |
| Concordance (CCC) | 0.87 | 0.97 | 0.99 | 0.82 | 0.94 |
Mechanisms
Practical Application
Limitations
How this entry was checked and changed
a test validation study (rubric B) with many nights (536) but few people (n = 13) and a chest-strap rather than clinical ECG criterion, read from the full text (open access, CC BY 4.0). Held at B- for a serious limitation beyond the design: several reported numbers contradict each other (the Polar rows of both agreement tables, within-person concordances in the text against the tables, an ANOVA statement about a device excluded from that analysis, and a Conclusion that ranks the Polar watch's HRV above the Garmin's against its own Results), and neither firmware nor nights per person are reported. The Oura, WHOOP and Garmin HRV rows check out arithmetically