<![CDATA[Many students experience fatigue due to lack of sleep which can be caused by a psychological conditions or bad habits. Lack of sleep can affect student’s performance academically and causes many illnesses, stress and depression. Students with fatigue causes students to not study well, increasing risk of academic failure and will lead to having low GPA. In this research, fatigue detection is carried out to find out which students are experiencing fatigue. In this study, an annotated video dataset was used with a total of 18 subjects acted drowsy and alert. Fatigue detection is based on mouth movements, therefore mouth annotation is used. Mouth annotation has 2 categories, namely annotation 0 which indicates a closed mouth and annotation 1 which indicates the mouth is yawning. Previous study proves ResNet50 has better performance than other pre-trained models such as AlexNet, Clarifia, VGG-16, and GoogLeNet-19. We also applied image augmentation which is useful for providing new image variations to the model in each epoch by changing the rotation, random shift, and random zoom. ResNet50 model is used to perform binary classification which has two outputs, namely mouth stillness and yawning. The results of the frame classification are evaluated using precision, recall and f1-score. By using ResNet model, the results of the classification of frames labeled 0 or mouth stillness, obtained a precision of 0.72, a recall of 0.88, and an f1-score of 0.79. Meanwhile, the frame classification labeled 1 or yawning has a precision value of 0.85, a recall of 0.65, and an f1-score of 0.74.]]>
Copyrights © 2021
