Utilizing Machine Learning for Behavioral Analysis in Educational Environments: A Study on Student Engagement and Classroom

Authors

  • Zin Mar Soe School of AI Computing & Multimedia, Lincoln University College, Malaysia

DOI:

https://doi.org/10.60072/ijeissah.2026.v4i02.007

Abstract

The quality of students’ learning experiences is closely linked to their level of interest, effective teaching practices, and a safe, supportive classroom environment. While skilled teachers can simplify challenging subjects and help students achieve academic success, learning outcomes remain limited when students are disengaged or unmotivated. For school administrators and education policymakers, understanding these classroom dynamics is essential, yet continuous observation of students and teachers is difficult, time‑consuming, and often subjective. Students’ facial expressions and body language offer important clues about their attention, emotions, and engagement. However, it is not realistic for teachers to consistently monitor these subtle cues while teaching. To address this challenge, this concept paper explores the use of machine learning to support behavioral analysis in both physical and online classroom settings. The proposed approach combines YOLO version 7 (You Only Look Once) to detect behaviors such as posture, gestures, and facial presence, with the Facial Action Coding System (FACS) to identify micro‑expressions associated with emotions including happiness, confusion, anger, and boredom. Data are drawn from CCTV recordings in physical classrooms and video recordings from online learning environments. As a concept paper, the empirical results are still in development. Nevertheless, the proposed framework is expected to offer teachers and school administrators clearer, more objective insights into student behavior. These insights may help schools improve learning environments, refine instructional strategies, and better understand whether student disengagement stems from digital device use, teaching methods, or unengaging learning materials.

Keywords:

Classroom Dynamics, Facial Expressions, Machine Learning, Student Behavior, Student Engagement

References

Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Prentice-Hall. Englewood Cliffs, NJ, 1986(23-28), 2. https://shorturl.at/u42Ru

Lo, K. W., Ngai, G., Chan, S. C., & Kwan, K. P. (2022). How students’ motivation and learning experience affect their service-learnin g outcomes: A structural equation modeling analysis. Frontiers in psychology, 13, 825902. https://doi.org/10.3389/fpsyg.2022.825902

Chen, H., & Guan, J. (2022). Teacher–Student Behavior Recognition in Classroom Teaching Based on Improved YOLO-v4 and Internet of Things Technology. Electronics, 11(23), 3998. https://doi.org/10.3390/electronics11233998

Dewan, M. A. A., Murshed, M., & Lin, F. (2019). Engagement detection in online learning: A review. Smart Learning Environments, *6*(1), 1–20. https://doi.org/10.1186/s40561-018-0080-z

Ekman, P., & Friesen, W. V. (1978). Facial action coding system. Environmental Psychology & Nonverbal Behavior. https://doi.org/10.1037/t27734-000

Grafsgaard, J. F., Wiggins, J. B., Boyer, K. E., Wiebe, E. N., & Lester, J. C. (2013). Automatically recognizing facial indicators of frustration: a learning-centric analysis. In 2013 humaine association conference on affective computing and intelligent interaction (pp. 159-165). International Educational Data Mining Society. https://doi.org/10.1109/ACII.2013.33

Kearsley, G., & Shneiderman, B. (1998). Engagement theory: A framework for technology-based teaching and learning. Educational Technology, 38(5), 20–23. https://www.jstor.org/stable/44428478

Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://psycnet.apa.org/buy/2000-13324-007

Laslett, R., & Smith, C. (2002). Effective classroom management: A teacher's guide. Routledge. file:///C:/Users/LEPL/Downloads/10.4324_9780203130087_previewpdf%20(1).pdf

Stroebe, W. (2020). Student evaluations of teaching encourage poor teaching and contributes to grade inflation: A theoretical and empirical analysis. Basic and Applied Social Psychology, 42(4), 276–294. https://doi.org/10.1080/01973533.2020.1756817

Trabelsi, Z., Alnajjar, F., Parambil, M. M. A., Gochoo, M., & Ali, L. (2023). Real-Time Attention Monitoring System for Classroom: A Deep Learning Approach for Student’s Behavior Recognition. Big Data and Cognitive Computing, 7(1), 48. https://doi.org/10.3390/bdcc7010048

Tran, N., Nguyen, H., Luong, H., Nguyen, M., Luong, K., & Tran, H. (2023). Recognition of student behavior through actions in the classroom. IAENG International Journal of Computer Science, 50(3), 1031-1041. https://www.iaeng.org/IJCS/issues_v50/issue_3/IJCS_50_3_26.pdf

Wang, Z., Yao, J., Zeng, C., Wu, W., Xu, H., & Yang, Y. (2023). Learning behavior recognition in smart classroom with multiple students based on YOLOv5. https://doi.org/10.48550/arXiv.2303.10916

Zhou, J. Y. (2023). YOLO-Based Real Time Face Detection and Expression Recognition (Outstanding Academic Papers by Students, OAPS). http://oaps.umac.mo/handle/10692.1/296

Downloads

Published

17-04-2026

How to Cite

Soe , Z. M. (2026). Utilizing Machine Learning for Behavioral Analysis in Educational Environments: A Study on Student Engagement and Classroom. International Journal of Emerging Issues in Social Science, Arts and Humanities ( IJEISSAH), 4(2), 64-72. https://doi.org/10.60072/ijeissah.2026.v4i02.007

Metrics