Classifying Cognitive Workload Using Machine Learning Techniques and Non-Intrusive Wearable DevicesYunmei Liu, Nicolas S. Grimaldi, Niosh Basnet, David Wozniak, Eric Chen, Maryam Zahabi, David Kaber, and Jaime Ruiz
Effective management of cognitive workload is essential to ensure user performance and minimize mental fatigue. This study aimed to evaluate the effectiveness of three machine learning (ML) algorithms, including a Support Vector Machine (SVM), a Random Forest (RF) and Random Fourier Features (RFF) models, for predicting instances of high cognitive workload based on physiological data collected from non-intrusive wearable devices. The study included scenarios to induce high workload. After processing data from 30 human participants, and extracting cognitive workload-related features, we evaluated the ML algorithms in terms of accuracy, Area Under the Curve (AUC), and Average Precision (AP) responses. The RFF model emerged as a top performer, achieving 97% accuracy, 99.5% AUC, and 99% AP, demonstrating the capability to detect high workload scenarios and robustness to unbalanced data in workload predictions. The most significant physiological features in the RFF model included skin conductance level (SCL) change, SCL mean, and percent change in pupil size. Future studies should enhance the present binary classification model to support multi-class or continuous workload predictions and implement real-time analysis using trained algorithms.
Citation
Yunmei Liu, Nicolas S. Grimaldi, Niosh Basnet, David Wozniak, Eric Chen, Maryam Zahabi, David Kaber, and Jaime Ruiz. 2024. Classifying Cognitive Workload Using Machine Learning Techniques and Non-Intrusive Wearable Devices. In 2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS), 1–6. https://doi.org/10.1109/ichms59971.2024.10555690
Bibtex
@INPROCEEDINGS{10555690,
author={Liu, Yunmei and Grimaldi, Nicolas S. and Basnet, Niosh and Wozniak, David and Chen, Eric and Zahabi, Maryam and Kaber, David and Ruiz, Jaime},
booktitle={2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS)},
title={Classifying Cognitive Workload Using Machine Learning Techniques and Non-Intrusive Wearable Devices},
year={2024},
volume={},
number={},
pages={1-6},
keywords={Support vector machines;Performance evaluation;Machine learning algorithms;Accuracy;Predictive models;Prediction algorithms;Feature extraction;Cognitive workload;machine learning;physiological signals;workload prediction},
doi={10.1109/ICHMS59971.2024.10555690}}