Written by the Nuvirox Research Team
Key points
- In a 2024 polysomnography comparison, the highest-performing consumer sleep tracker only reached a macro F1 score of 0.69 against lab-grade sleep staging.
- Even trained human technicians scoring the same lab data agree with each other only about 80% of the time, so devices are working against a genuinely fuzzy gold standard.
- "Orthosomnia" — anxiety from obsessing over sleep tracker data — is now a recognized, studied phenomenon in sleep medicine.
Short answer: the mismatch is very likely your tracker, not your body — and chasing the number can genuinely make your sleep worse. Consumer sleep trackers are useful for spotting broad trends over weeks, but validation studies comparing them directly against polysomnography (the lab gold standard) consistently find meaningful disagreement, especially on sleep stages rather than simple sleep-versus-wake detection.
How accurate are consumer sleep trackers, really?
A 2023 multicenter validation study compared 11 popular consumer sleep trackers — including Oura Ring, Apple Watch, Fitbit, and several under-mattress devices — against polysomnography across 543 hours of recordings. The best-performing device reached a macro F1 score (a combined accuracy measure) of only 0.69; the worst reached 0.26. A separate 2024 study of three popular wearables found detecting sleep-versus-wake was excellent (95%+ sensitivity across all three), but discriminating between sleep stages — light, deep, REM — ranged from 50% to 86% sensitivity depending on the device and stage. A newer six-device comparison found Cohen's kappa agreement scores (a statistical measure of agreement beyond chance) ranging from just 0.21 to 0.53 against polysomnography — described by the researchers themselves as only "fair to moderate" agreement.
📋 Study snapshot: 11-device consumer sleep tracker validation
| Design | Multicenter, PSG-controlled |
| Participants | 75, across 2 centers |
| PSG hours recorded | 543 |
| Best device macro F1 | 0.69 |
| Worst device macro F1 | 0.26 |
| Finding | Substantial variation by device and sleep stage |
So why does my tracker say I slept badly when I feel fine?
Two honest possibilities, and they're not mutually exclusive. First, the device may simply be wrong — the studies above show real disagreement even against lab-grade equipment, and one analysis found a leading wearable overestimated light sleep by 45 minutes and underestimated deep sleep by 43 minutes in a single night compared to polysomnography. Second, subjective sleep quality (how rested you feel) and objective sleep architecture (what stage you were in and for how long) aren't the same thing — a night with technically "less deep sleep" by a device's algorithm doesn't necessarily match how restored you actually feel, especially since even trained human sleep technicians scoring identical lab recordings only agree with each other about 80% of the time. That's the ceiling any device is working against.
What is orthosomnia, and could it apply to you?
Orthosomnia is a term coined in a 2017 case-series study describing patients who developed anxiety and even sought treatment for self-diagnosed sleep disturbances based purely on their tracker data — despite validation research showing these devices can't reliably discriminate sleep stages. A larger 2024 cross-sectional study of 523 participants developed a formal algorithm for identifying likely orthosomnia and found that among regular sleep-tracker users (35.8% of the sample), a meaningful share showed patterns consistent with tracker-driven sleep anxiety. Researchers describe a feedback loop: an anxious person checks their score, the score is imperfect, the imperfection feeds anxiety about sleep, and that anxiety can genuinely worsen the sleep being measured.
What to actually do about it
- Trust how you feel over the daily number — if you feel rested, a device's imperfect deep-sleep estimate isn't strong enough evidence to override that.
- Look at multi-week trends, not single nights — even imperfect devices tend to be more informative about your relative patterns over time than about any one night's precise numbers.
- Consider a short break from checking your score if you notice yourself feeling anxious about it — researchers studying orthosomnia specifically suggest this as a reset.
- If sleep concerns persist regardless of what your tracker says, a real sleep study (polysomnography) remains the accurate way to evaluate it — talk to a doctor rather than relying on consumer data for a genuine medical question.
Frequently asked questions
Should I trust my sleep tracker's deep sleep or REM numbers?
Treat them as rough estimates, not precise measurements. Validation studies consistently find sleep-stage discrimination (light vs. deep vs. REM) is meaningfully less accurate than simple sleep-versus-wake detection, which most devices do quite well.
Is it bad to check my sleep score every morning?
For most people, occasional checking is fine. But if you notice the score is making you anxious about sleep, or you're changing behavior (like lying still longer to "improve" the number) based on it, that pattern is consistent with what researchers call orthosomnia and is worth stepping back from.
Are any sleep trackers accurate?
Some perform meaningfully better than others in head-to-head validation studies, particularly for basic sleep-versus-wake detection, but none matched polysomnography closely enough on sleep-stage detail to be treated as a clinical-grade measurement in the studies reviewed here.
From Nuvirox

Why we formulated Sleep+ Restore
If a tracker score has you second-guessing sleep that actually felt fine, the fix usually isn’t more optimization — it's a reliable wind-down you don't have to measure. Sleep+ Restore’s melatonin-and-botanical blend is meant to support that consistent bedtime cue, not to be chased or graded night to night.
Learn more about Sleep+ Restore →The bottom line
Consumer sleep trackers are genuinely useful for spotting broad, multi-week trends, but validation research shows real disagreement with lab-grade sleep staging — and even human experts don't fully agree with each other on the same data. If your tracker says you slept badly but you feel fine, the honest reading of the evidence is to trust how you feel. If checking your score is making you anxious, that's a documented pattern worth stepping back from.
Why can two different trackers disagree about the same night of sleep?
Different devices use different underlying signals and proprietary algorithms — heart rate variability, movement, sometimes body temperature or blood oxygen — to estimate sleep stages, and manufacturers generally don't disclose the exact methodology behind their scoring. A 2023 multicenter validation study directly comparing 11 devices found substantial variation in performance even within the same night's data, which is part of why it's common for two trackers worn simultaneously to report meaningfully different sleep scores for the same person on the same night.
What should I actually use a sleep tracker for, if not precise nightly scoring?
Most sleep researchers who study these devices suggest they're more useful for spotting broad, multi-week trends — whether your average bedtime is drifting later, whether a new medication or habit correlates with a shift in your resting heart rate, or whether total sleep opportunity is chronically too short — than for evaluating any single night in isolation. Treated that way, the devices' imperfect absolute accuracy matters less, since you're looking at relative change over time rather than a precise nightly grade.
References
- Accuracy of 11 Wearable, Nearable, and Airable Consumer Sleep Trackers: Prospective Multicenter Validation Study. JMIR mHealth Uhealth. 2023. PMCID: PMC10654909.
- Accuracy of Three Commercial Wearable Devices for Sleep Tracking in Healthy Adults. Sensors. PMCID: PMC11511193.
- A performance validation of six commercial wrist-worn wearable sleep-tracking devices for sleep stage scoring compared to polysomnography. Sleep Adv. 2025. PMCID: PMC12038347.
- Baron KG, et al. Orthosomnia: Are Some Patients Taking the Quantified Self Too Far? J Clin Sleep Med. 2017. PMCID: PMC5263088.
- Prevalence of Orthosomnia in a General Population Sample: A Cross-Sectional Study. PMCID: PMC11592250.
If tracker-related anxiety about sleep is affecting your daily functioning or mental health more broadly, it's worth discussing with a doctor or therapist.
Related reading
*These statements have not been evaluated by the Food and Drug Administration. This product is not intended to diagnose, treat, cure, or prevent any disease. This article is for informational purposes only and is not a substitute for professional medical advice.