English
Related papers

Related papers: Exploring Automated Recognition of Instructional A…

200 papers

The promise of generative AI to revolutionize education is constrained by the pedagogical limits of large language models (LLMs). A major issue is the lack of access to high-quality training data that reflect the learning of actual…

Computation and Language · Computer Science 2025-10-07 Janos Perczel , Jin Chow , Dorottya Demszky

Large language models (LLMs) are increasingly adopted in educational technologies for a variety of tasks, from generating instructional materials and assisting with assessment design to tutoring. While prior work has investigated how models…

Computation and Language · Computer Science 2025-12-24 Kirk Vanacore , Rene F. Kizilcec

The flipped classroom is a new pedagogical strategy that has been gaining increasing importance recently. Spoken discussion dialog commonly occurs in flipped classroom, which embeds rich information indicating processes and progression of…

Computers and Society · Computer Science 2025-09-22 Hang Su , Borislav Dzodzo , Changlun Li , Danyang Zhao , Hao Geng , Yunxiang Li , Sidharth Jaggi , Helen Meng

This work deviates from easy-to-define class boundaries for object interactions. For the task of object interaction recognition, often captured using an egocentric view, we show that semantic ambiguities in verbs and recognising…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Michael Wray , Davide Moltisanti , Walterio Mayol-Cuevas , Dima Damen

The aim of the work presented in this paper is to develop and evaluate an integrated system that provides automated lecture style evaluation, allowing teachers to get instant feedback related to the goodness of their lecturing style. The…

Computers and Society · Computer Science 2023-12-29 Eleni Dimitriadou , Andreas Lanitis

Manual annotation remains the gold standard for high-quality, dense temporal video datasets, yet it is inherently time-consuming. Vision-language models can aid human annotators and expedite this process. We report on the impact of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Juan Gutiérrez , Victor Gutiérrez , Ángel Mora , Silvia Rodriguez , José Luis Blanco

Training computer-use agents requires massive amounts of GUI interaction data, but manually annotating action trajectories at scale is prohibitively expensive. We present VideoAgentTrek, a scalable pipeline that automatically mines training…

Providing timely and actionable feedback on oral presentation slides is challenging in higher education, particularly in large classes where teachers cannot realistically deliver detailed formative feedback before students present. This…

Human-Computer Interaction · Computer Science 2026-05-07 Alvaro Becerra , Diego Gomez , Ruth Cobos

Dialogue Acts (DAs) can be used to explain what expert tutors do and what students know during the tutoring process. Most empirical studies adopt the random sampling method to obtain sentence samples for manual annotation of DAs, which are…

Computation and Language · Computer Science 2023-04-13 Wei Tan , Jionghao Lin , David Lang , Guanliang Chen , Dragan Gasevic , Lan Du , Wray Buntine

Large language models (LLMs) hold great promise for educational applications, particularly in intelligent tutoring systems. However, effective tutoring requires alignment with pedagogical strategies - something current LLMs lack without…

Computation and Language · Computer Science 2025-06-10 Kseniia Petukhova , Ekaterina Kochmar

Assessing learner competency in clinical simulation requires expert observation that is time-intensive, difficult to scale, and subject to inter-rater variability. Vision-language models have emerged as a promising tool for understanding…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hanchen David Wang , Yilin Liu , Madison J. Lee , Surya Chand Rayala , Gautam Biswas , Daniel T. Levin , Meiyi Ma

Classroom discourse is a core medium of instruction - analyzing it can provide a window into teaching and learning as well as driving the development of new tools for improving instruction. We introduce the largest dataset of mathematics…

Computation and Language · Computer Science 2023-05-26 Dorottya Demszky , Heather Hill

Audio-visual learning has been a major pillar of multi-modal machine learning, where the community mostly focused on its modality-aligned setting, i.e., the audio and visual modality are both assumed to signal the prediction target. With…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Yung-Hsuan Lai , Yen-Chun Chen , Yu-Chiang Frank Wang

Natural Language Understanding (NLU) models are typically trained in a supervised learning framework. In the case of intent classification, the predicted labels are predefined and based on the designed annotation schema while the labelling…

Evaluating AI tutor responses requires more than factual correctness: tutors must identify mistakes, locate errors, provide guidance, and offer actionable next steps. We present GRADE, a systematic study of open-source models for…

Computation and Language · Computer Science 2026-05-28 Parth Bhalerao , Jeromy Chang , David Chou , Oana Ignat

Standardized Student Evaluation of Teaching often suffer from low reliability, restricted response options, and response distortion. Existing machine learning methods that mine open-ended comments usually reduce feedback to binary…

Computation and Language · Computer Science 2026-01-15 Xiangqian Wang , Yifan Jia , Yang Xiang , Yumin Zhang , Yanbin Wang , Ke Liu

This paper introduces a novel computational approach for analyzing nonverbal social behavior in educational settings. Integrating multimodal behavioral cues, including facial expressions, gesture intensity, and spatial dynamics, the model…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Uroš Petković , Jonas Frenkel , Olaf Hellwich , Rebecca Lazarides

Deep learning algorithms have pushed the boundaries of computer vision research and have depicted commendable performance in a variety of applications. However, training a robust deep neural network necessitates a large amount of labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Debanjan Goswami , Shayok Chakraborty

Large Language Models (LLMs) are democratizing access to personalized tutoring; however, their effectiveness is hindered by challenges in processing multimodal content, which limits AI's potential to provide equitable, high-quality STEM…

This shared task has aimed to assess pedagogical abilities of AI tutors powered by large language models (LLMs), focusing on evaluating the quality of tutor responses aimed at student's mistake remediation within educational dialogues. The…

Computers and Society · Computer Science 2025-07-16 Ekaterina Kochmar , Kaushal Kumar Maurya , Kseniia Petukhova , KV Aditya Srivatsa , Anaïs Tack , Justin Vasselli