Native Apple Watch wins in most scientific papers and also in tests done by “the quantified scientist” by a large margin. Apple Watch does not use HRV but accelerometer for movement and breathing rate.
Apple Watch also wins for HR during exercise.
So if you want one device for everything, there is little competition yet.
I'd love to see this comparison between Garmin and Oura. I ditched Whoop because it was too easy to get 100 sleep scores, but my Garmin watch is much harder to please. I do think it offers better signal, but I've never scored over a 90, so maybe it is too critical?
I had over 90 scores, and only when I get earlier in bed and if there are medications involved. you do feel like you had a great sleep so for me it's very accurate.
I've found Garmin's sleep tracking to be unreliable. For instance, if I lie in bed reading before I fall asleep, it often incorrectly logs that time as sleep.
Apple's health app is extremely careful not to say what is 'good' or 'bad' about the metrics it monitors, I find. The sleep tracking really just gives you a breakdown of sleep stages and length of sleep, rather than a sleep score that the o ther apps give you. I believe that is what Karpathy is comparing, not the telemetry itself, rather the measured sleep quality mapped to his perceived sleep quality, which Apple doesn't really give you.
From TFA: Maybe there is a better app on Apple Watch for sleep tracking, but I haven't found it.
And what other apps were tried? As you ask, why not try the default? From what I hear, it is “better” (for whatever that means) than Garmin, for example, on sleep tracking. I dunno, it is kind weird to start comparisons with some random paid app rather than the built-in that Apple offers for free.
Nice article but I with there was something more authoritative to compare it to. I know controlled in-lab sleep studies are expensive but this would be the key data to have in the mix.
The Quantified Scientist YouTube channel by Rob ter Horst does a good job imo at comparing trackers against an industry standard baseline. For sleep he uses the Z-Max EEG device.
Really surprised that Autosleep performed so poorly. I've been using it for over a year and I'm pretty satisfied, and chose it because it was the only apple watch sleep app I could find that didn't require a monthly subscription. Admittedly I don't look at the 'score' so perhaps that's it, I just look at the overall 'quality sleep' hours and have found that tracks pretty well with how off-my-game I am that day.
I enjoy Peter Norvig's writing style—it's rich in detail and backed by solid statistics. I've also been following Andrej Karpathy for the past two years, and I have to say, his writing has become my top priority to read first.
My Garmin Instinct Crossover watch does a great job of sleep tracking. It correlates well with how I feel the next day and how active I was the day before. On the other hand, Sleep as Android inflates the scores too much to be useful.
Apple Watch also wins for HR during exercise.
So if you want one device for everything, there is little competition yet.
that said, when I do get very good or very poor sleep, the score reflects it.
And what other apps were tried? As you ask, why not try the default? From what I hear, it is “better” (for whatever that means) than Garmin, for example, on sleep tracking. I dunno, it is kind weird to start comparisons with some random paid app rather than the built-in that Apple offers for free.