Comparison of Automatic Sleep Stage Classification Methods for Clinical Use
Main Article Content
Keywords
Polysomnography, Sleep stage scoring, Machine learning, Deep learning, Signal processing
Abstract
Sleep stage scoring is necessary for diagnosing several sleep disorders. However, it is an intensive and repetitive task and a vital automation candidate. This work seeks to evaluate different kinds of Machine Learning based classification algorithms available in the scientific literature to determine which one fits better the clinical practice requirements. The comparison is made with a predefined experimental design, using electroencephalography, electrooculography, and electromyography signals from the polysomnographic records of the Sleep-EDFx dataset. The comparison considers the accuracy and speed of algorithms based on Linear Discriminate Analysis, Support Vector Machines, Random Forests, and Artificial Neural Networks. The latter group includes the Deep Neural Networks DeapFeatureNet, based on Convolutional Neural Networks, and DeepSleepNet, additionally based on Recurrent Neural Networks. It is determined that several of the tested algorithms boast high accuracy levels (85%). From them, DeepSleepNet is chosen as the fittest due to its considerable advantage in execution time. Nevertheless, the final result should always be reviewed by the experts.
Downloads
Abstract 783 | PDF Downloads 629
References
2. Daker-Hopfe H, Anderer P, Zeitlhofer J, Boeck M, Dorn H, Gruber G, et al. Interrater reliability for sleep scoring according to the Rechtschaffen & Kales and the new AASM standard. J Sleep Res. 2009;78–84. https://doi.org/10.1111/j.1365-2869.2008.00700.x.
3. Fraiwan L, Lweesy K, Khasawneh N, Fraiwan M, Wenz H, Dickhaus H. Classification of sleep stages using multi-wavelet time frequency entropy and LDA. Methods of information in medicine. 2010 Jan;49:230–7. https://doi.org/10.3414/ME09-01-0054.
4. Ichimaru Y, Moody GB. Development of the poly-somnographic database on CD-ROM. Psychiatry and Clinical Neurosciences. 1999;53:175–7. https://doi.org/10.1046/j.1440-1819.1999.00527.x.
5. Goldberger AL, Amaral LAN, Glass L, Hausdorff JM, Ivanov PC, Mark RG, et al. PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals. Circulation. 2000 Jun 13;101(23). https://www.ahajournals.org/doi/10.1161/01.CIR.101.23.e215.
6. Susmakova K, Krakovska A. Discrimination ability of individual measures used in sleep stages classification. Artificial Intelligence in Medicine. 2008 Nov;44(3):261–77. https://doi.org/10.1016/j.artmed.2008.07.005.
7. Koley B, Dey D. An ensemble system for automatic sleep stage classification using single channel EEG signal. Computers in Biology and Medicine. 2012;42(12):1186–95. https://doi.org/10.1016/j.compbiomed.2012.09.012.
8. Aboalayon K, Ocbagabir H, Faezipour M. Efficient sleep stage classification based on EEG signals. In: Applications and technology conference. 2014. https://doi.org/10.1109/LISAT.2014.6845193.
9. Kemp B, Zwinderman AH, Tuk B, Kamphuisen HAC, Oberye JJL. Analysis of a sleep-dependent neuronal feedback loop: The slow-wave microcontinuity of the EEG. IEEE Transactions on Biomedical Engineering. 2000;47(9):1185–94. https://doi.org/10.1109/10.867928.
10. Sen B, Peker M, Cavusoglu A, Celebi FV. A comparative study on classification of sleep stage based on EEG signals using feature selection and classification algorithms. J Med Syst. 2014; https://doi.org/10.1007/s10916-014-0018-0.
11. Aboalayon K, Faezipour M, Almuhammadi W, Moslehpour S. Sleep stage classification using EEG signal analysis: A comprehensive survey and new investigation. Entropy. 2016 Aug;18. https://doi.org/10.3390/e18090272.
12. Zhang Y, Yang Z, Lan K, Liu X, Zhang Z, Li P, et al. Sleep stage classification using bidirectional LSTM in wearable multi-sensor systems [Internet]. 2019. Available from: https://arxiv.org/abs/1909.11141.
13. Yildirim O, Baloglu UB, Acharya UR. A deep learning model for automated sleep stages classification using PSG signals. Int J Environ Res Public Helth. 2019; https://doi.org/10.3390/ijerph16040599.
14. Supratak A, Dong H, Wu C, Guo Y. DeepSleepNet: A model for automatic sleep stage scoring based on raw single-channel EEG. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2017; https://doi.org/10.1109/TNSRE.2017.2721116.
15. Rechstaffen A, Kales A. A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects. In: A manual of standardized terminology. Los Angeles, California: University of California; 1986.
16. Frank E, Hall MA, Holmes G, Kirkby R, Pfahringer B, Witten IH. Weka: A machine learning workbench for data mining. In: Data mining and knowledge discovery handbook: A complete guide for practitioners and researchers [Internet]. Berlin: Springer; 2005. pp. 1305–14. Available from: http://researchcommons.waikato.ac.nz/handle/10289/1497.
17. Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH. The WEKA data mining software: An update. SIGKDD Explorations. 2009;11(1):10–8. https://doi.org/10.1145/1656274.1656278.
18. Sabeti M, Katebi S, Boostani R. Entropy and complexity measures for EEG signal classification of schizophrenic and control participants. Artificial Intelligence in Medicine. 2009 Nov;47(3):263–74. https://doi.org/10.1016/j.artmed.2009.03.003.
19. Rosenstein MT, Collins JJ, Luca CJD. A practical method for calculating largest Lyapunov exponents from small data sets. Physica D: Nonlinear Phenomena. 1993 Jun;65(1-2):117–34. https://doi.org/10.1016/0167-2789(93)90009-P.
20. Phinyomark A, Thongpanja S, Hu H, Phukpattaranont P, Limsakul C. The usefullness of mean and median frequencies in electromiography analysis, computational intelligence in electromiography analysis - a perspective on current applications and future challenges. In IntechOpen; 2012. https://doi.org/10.5772/50639.
21. Acharya R, Chua EC-P, Chua KC, Min LC, Tamura T. Analysis and automatic identification of sleep stages using higher order spectra. International Journal of Neural Systems. 2010 Nov;20(6):509–21. https://doi.org/10.1142/S0129065710002589.
22. Stark H-G. Wavelets and signal processing: An application-based introduction. Springer; 2005. https://doi.org/10.1007/3-540-27481-2.
23. Tzimourta KD, Tsilimbaris A, Tzioukalia K, Tzallas AT, Tsipouras MG, Astrakas LG, et al. EEG-based automatic sleep stage classification. Biomedical Journal of Scientific & Technical Research. 2018;7(4):6032–7. https://doi.org/10.26717/BJSTR.2018.07.001535.
24. Fraiwan L, Lweesy K, Khasawneh N, Wenz H, Dickhaus H. Automated sleep stage identification system based on time–frequency analysis of a single EEG channel and random forest classifier. Computer Methods and Programs in Biomedicine. 2012;108:10–9. https://doi.org/10.1016/j.cmpb.2011.11.005.
25. Ronzhina M, Janousek O, Kolarova J, Novakova M, Honzik P, Provaznik I. Sleep scoring using artificial neural networks. Sleep Medicine Reviews. 2012;16(3):251–63. https://doi.org/10.1016/j.smrv.2011.06.003.
26. Dong H, Supratak A, Pan W, Wu C, Matthews PM, Guo Y. Mixed neural network approach for temporal sleep stage classification. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2018; https://doi.org/10.1109/TNSRE.2017.2733220.
27. Koushik A, Amores J, Maes P. Real-time sleep staging using deep learning on a smartphone for a wearable EEG. CoRR [Internet]. 2018;abs/1811.10111. Available from: http://arxiv.org/abs/1811.10111.
28. Mousavi S, Afghah F, Acharya UR. SleepEEGNet: Auto-mated sleep stage scoring with sequence to sequence deep learning approach. Pławiak P, editor. PLOS ONE [Internet]. 2019 May;14(5). Available from: http://dx.doi.org/10.1371/journal.pone.0216456.
29. Mendonça F, Mostafa SS, Morgado-Dias F, Ravelo-García AG, Penzel T. A review of approaches for sleep quality analysis. IEEE Access. 2019;7:24527–46. https://doi.org/10.1109/ACCESS.2019.2900345.
30. Boostani R, Karimzadeh F, Torabi-Nami M. A comparative review on sleep stage classification methods in patients and healthy individuals. HAL. 2017 Mar;140:77–91. https://doi.org/10.1016/j.cmpb.2016.12.004.
Article Sidebar
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Author(s) must obtain all parties consent [co-author(s), others if applicable] and submit the acceptance of Copyright Agreement with their paper. Written permission must be obtained by the author for material that has been published in copyrighted material; this includes tables, figures, and quoted text that exceeds 150 words. A copy of all permissions must accompany the manuscript when published in copyrighted material. The author(s) hereby represents and warrants that the paper is original and that he/she is the author of the paper, except for material that is clearly identified as to its original source, with permission notices from the copyright owners where required. Author(s) must clearly indicate that approval for publication has been received in cases of institutional ownership.
In all submitted material authors retain all copyrights; however, the GlobalCE Journal reserve the right to reprint all or portions of the article and to post all or part of the article online. GlobalCE Journal reserves the right to edit manuscripts as required to publish in the journal. Authors are responsible for obtaining any and all clearances as appropriate. Unless stated otherwise, all articles are open-access and distributed under the terms of the Creative Commons Attribution License (CC BY 4.0) which permits unrestricted use, distribution, and reproduction in any medium, provided the original author(s) and original work (e.g. first published in the Global Clinical Engineering Journal) is properly cited with the original URL and bibliographic citation information. The complete bibliographic information, a link to the original publication on www.Globalce.org well as the copyright and license information must be included. No use, distribution or reproduction is permitted which does not comply with these terms.
