English

Modeling Engagement Signals in Technology-Enhanced Collaborative Learning: Toward AI-Ready Feedback

Human-Computer Interaction 2026-01-21 v1 Computers and Society

Abstract

Modeling engagement in collaborative learning remains challenging, especially in technology-enhanced environments where surface indicators such as participation frequency can be misleading. This study proposes a lightweight and interpretable framework that operationalizes shared understanding (Q2), consensus building (Q4), and sustained motivation (Q6) as observable behavioral signals. Q2 and Q4 were consolidated into a Composite Signal Index (CSI), which supports a quadrant diagnostic model with implications for teacher- and AI-driven feedback. Constructive feedback (Q3), while not included in the CSI calculation, emerged as a meaningful regulatory cue and a strong candidate feature for future NLP-based modeling. An exploratory validation was conducted in an adult ESL classroom using a structured three-phase collaborative task (rotating reading -> retelling -> consensus). Results showed a positive association between CSI and sustained motivation, while qualitative reflections highlighted the potential role of Q3 in supporting shared regulation. We also designed an AI-ready prototype that maps structured behavioral cues onto transparent decision rules for instructional support. The framework provides a scalable and equitable approach to engagement modeling, emphasizing that silence does not equal disengagement and that frequent talk does not guarantee cognitive depth.

Keywords

Cite

@article{arxiv.2601.11549,
  title  = {Modeling Engagement Signals in Technology-Enhanced Collaborative Learning: Toward AI-Ready Feedback},
  author = {Joan Zhong},
  journal= {arXiv preprint arXiv:2601.11549},
  year   = {2026}
}
R2 v1 2026-07-01T09:08:03.611Z