Utilizing Machine Learning for Behavioral Analysis in Educational Environments: A Study on Student Engagement and Classroom
DOI:
https://doi.org/10.60072/ijeissah.2026.v4i02.007Abstract
The quality of students’ learning experiences is closely linked to their level of interest, effective teaching practices, and a safe, supportive classroom environment. While skilled teachers can simplify challenging subjects and help students achieve academic success, learning outcomes remain limited when students are disengaged or unmotivated. For school administrators and education policymakers, understanding these classroom dynamics is essential, yet continuous observation of students and teachers is difficult, time‑consuming, and often subjective. Students’ facial expressions and body language offer important clues about their attention, emotions, and engagement. However, it is not realistic for teachers to consistently monitor these subtle cues while teaching. To address this challenge, this concept paper explores the use of machine learning to support behavioral analysis in both physical and online classroom settings. The proposed approach combines YOLO version 7 (You Only Look Once) to detect behaviors such as posture, gestures, and facial presence, with the Facial Action Coding System (FACS) to identify micro‑expressions associated with emotions including happiness, confusion, anger, and boredom. Data are drawn from CCTV recordings in physical classrooms and video recordings from online learning environments. As a concept paper, the empirical results are still in development. Nevertheless, the proposed framework is expected to offer teachers and school administrators clearer, more objective insights into student behavior. These insights may help schools improve learning environments, refine instructional strategies, and better understand whether student disengagement stems from digital device use, teaching methods, or unengaging learning materials.
Keywords:
Classroom Dynamics, Facial Expressions, Machine Learning, Student Behavior, Student EngagementReferences
Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Prentice-Hall. Englewood Cliffs, NJ, 1986(23-28), 2. https://shorturl.at/u42Ru
Lo, K. W., Ngai, G., Chan, S. C., & Kwan, K. P. (2022). How students’ motivation and learning experience affect their service-learnin g outcomes: A structural equation modeling analysis. Frontiers in psychology, 13, 825902. https://doi.org/10.3389/fpsyg.2022.825902
Chen, H., & Guan, J. (2022). Teacher–Student Behavior Recognition in Classroom Teaching Based on Improved YOLO-v4 and Internet of Things Technology. Electronics, 11(23), 3998. https://doi.org/10.3390/electronics11233998
Dewan, M. A. A., Murshed, M., & Lin, F. (2019). Engagement detection in online learning: A review. Smart Learning Environments, *6*(1), 1–20. https://doi.org/10.1186/s40561-018-0080-z
Ekman, P., & Friesen, W. V. (1978). Facial action coding system. Environmental Psychology & Nonverbal Behavior. https://doi.org/10.1037/t27734-000
Grafsgaard, J. F., Wiggins, J. B., Boyer, K. E., Wiebe, E. N., & Lester, J. C. (2013). Automatically recognizing facial indicators of frustration: a learning-centric analysis. In 2013 humaine association conference on affective computing and intelligent interaction (pp. 159-165). International Educational Data Mining Society. https://doi.org/10.1109/ACII.2013.33
Kearsley, G., & Shneiderman, B. (1998). Engagement theory: A framework for technology-based teaching and learning. Educational Technology, 38(5), 20–23. https://www.jstor.org/stable/44428478
Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://psycnet.apa.org/buy/2000-13324-007
Laslett, R., & Smith, C. (2002). Effective classroom management: A teacher's guide. Routledge. file:///C:/Users/LEPL/Downloads/10.4324_9780203130087_previewpdf%20(1).pdf
Stroebe, W. (2020). Student evaluations of teaching encourage poor teaching and contributes to grade inflation: A theoretical and empirical analysis. Basic and Applied Social Psychology, 42(4), 276–294. https://doi.org/10.1080/01973533.2020.1756817
Trabelsi, Z., Alnajjar, F., Parambil, M. M. A., Gochoo, M., & Ali, L. (2023). Real-Time Attention Monitoring System for Classroom: A Deep Learning Approach for Student’s Behavior Recognition. Big Data and Cognitive Computing, 7(1), 48. https://doi.org/10.3390/bdcc7010048
Tran, N., Nguyen, H., Luong, H., Nguyen, M., Luong, K., & Tran, H. (2023). Recognition of student behavior through actions in the classroom. IAENG International Journal of Computer Science, 50(3), 1031-1041. https://www.iaeng.org/IJCS/issues_v50/issue_3/IJCS_50_3_26.pdf
Wang, Z., Yao, J., Zeng, C., Wu, W., Xu, H., & Yang, Y. (2023). Learning behavior recognition in smart classroom with multiple students based on YOLOv5. https://doi.org/10.48550/arXiv.2303.10916
Zhou, J. Y. (2023). YOLO-Based Real Time Face Detection and Expression Recognition (Outstanding Academic Papers by Students, OAPS). http://oaps.umac.mo/handle/10692.1/296






















