TY - JOUR
T1 - Rigorous performance evaluation (previously, “validation”) for informed use of new technologies for sleep health measurement
AU - de Zambotti, Massimiliano
AU - Menghini, Luca
AU - Grandner, Michael A.
AU - Redline, Susan
AU - Zhang, Ying
AU - Wallace, Meredith L.
AU - Buxton, Orfeu M.
N1 - Publisher Copyright:
© 2022 The Authors
PY - 2022/6
Y1 - 2022/6
N2 - New sleep technologies have become pervasive in the consumer space, and are becoming highly common in research and clinical sleep settings. The rapid, widespread use of largely unregulated and unstandardized technology has enabled the quantification of many different facets of sleep health, driving scientific discovery. As sleep scientists, it is our responsibility to inform principles and practices for proper evaluation of any new technology used in the clinical and research settings, and by consumers. A current lack of standardized methods for evaluating technology performance challenges the rigor of our scientific methods for accurate representation of the sleep health facets of interest. This special article describes the rationale and priorities of an interdisciplinary effort for rigorous, standardized, and rapid performance evaluation (previously, “validation”) of new sleep and sleep disorders related technologies of all kinds (eg, devices or algorithms), including an associated article template for a new initiative for publication in Sleep Health of empirical studies systematically evaluating the performance of new sleep technologies. A structured article type should streamline manuscript development and enable more rapid writing, review, and publication. The goal is to promote rapid and rigorous evaluation and dissemination of new sleep technology, to enhance sleep research integrity, and to standardize terminology used in Rigorous Performance Evaluation papers to prevent misinterpretation while facilitating comparisons across technologies.
AB - New sleep technologies have become pervasive in the consumer space, and are becoming highly common in research and clinical sleep settings. The rapid, widespread use of largely unregulated and unstandardized technology has enabled the quantification of many different facets of sleep health, driving scientific discovery. As sleep scientists, it is our responsibility to inform principles and practices for proper evaluation of any new technology used in the clinical and research settings, and by consumers. A current lack of standardized methods for evaluating technology performance challenges the rigor of our scientific methods for accurate representation of the sleep health facets of interest. This special article describes the rationale and priorities of an interdisciplinary effort for rigorous, standardized, and rapid performance evaluation (previously, “validation”) of new sleep and sleep disorders related technologies of all kinds (eg, devices or algorithms), including an associated article template for a new initiative for publication in Sleep Health of empirical studies systematically evaluating the performance of new sleep technologies. A structured article type should streamline manuscript development and enable more rapid writing, review, and publication. The goal is to promote rapid and rigorous evaluation and dissemination of new sleep technology, to enhance sleep research integrity, and to standardize terminology used in Rigorous Performance Evaluation papers to prevent misinterpretation while facilitating comparisons across technologies.
KW - Actigraphy
KW - Algorithms
KW - Machine learning
KW - Performance evaluations
KW - Sensors
KW - Wearables
UR - http://www.scopus.com/inward/record.url?scp=85129409295&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85129409295&partnerID=8YFLogxK
U2 - 10.1016/j.sleh.2022.02.006
DO - 10.1016/j.sleh.2022.02.006
M3 - Article
C2 - 35513978
AN - SCOPUS:85129409295
SN - 2352-7218
VL - 8
SP - 263
EP - 269
JO - Sleep Health
JF - Sleep Health
IS - 3
ER -