English
Related papers

Related papers: M2LADS: A System for Generating MultiModal Learnin…

200 papers

Leaderboards are crucial in the machine learning (ML) domain for benchmarking and tracking progress. However, creating leaderboards traditionally demands significant manual effort. In recent years, efforts have been made to automate…

Machine Learning · Computer Science 2026-02-02 Roelien C. Timmer , Necva Bölücü , Stephen Wan

Machine learning models built on training data with multiple modalities can reveal new insights that are not accessible through unimodal datasets. For example, cardiac magnetic resonance images (MRIs) and electrocardiograms (ECGs) are both…

Machine Learning · Computer Science 2023-12-05 Bum Chul Kwon , Samuel Friedman , Kai Xu , Steven A Lubitz , Anthony Philippakis , Puneet Batra , Patrick T Ellinor , Kenney Ng

This work investigates the use of multimodal biometrics to detect distractions caused by smartphone use during tasks that require sustained attention, with a focus on computer-based online learning. Although the methods are applicable to…

Computers and Society · Computer Science 2025-06-25 Alvaro Becerra , Roberto Daza , Ruth Cobos , Aythami Morales , Mutlu Cukurova , Julian Fierrez

Oral presentation skills are a critical component of higher education, yet comprehensive datasets capturing real-world student performance across multiple modalities remain scarce. To address this gap, we present SOPHIAS (Student Oral…

Human-Computer Interaction · Computer Science 2026-01-13 Alvaro Becerra , Ruth Cobos , Roberto Daza

Most education and workplace learning takes place in classroom contexts far removed from laboratories or field sites with special arrangements for scientific research. But digital online resources provide a novel opportunity for large scale…

Computers and Society · Computer Science 2015-02-17 Joseph Jay Williams , Juho Kim , Brian C. Keegan

Supervised multi-modal learning involves mapping multiple modalities to a target label. Previous studies in this field have concentrated on capturing in isolation either the inter-modality dependencies (the relationships between different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Divyam Madaan , Taro Makino , Sumit Chopra , Kyunghyun Cho

Each year, multi-modal interaction continues to grow within both industry and academia. However, researchers have yet to fully explore the impact of multi-modal systems on learning and memory retention. This research investigates how…

Human-Computer Interaction · Computer Science 2025-09-09 Omar Elgohary , Zhu-Tien

Student modeling, the task of inferring a student's learning characteristics through their interactions with coursework, is a fundamental issue in intelligent education. Although the recent attempts from knowledge tracing and cognitive…

Artificial Intelligence · Computer Science 2023-04-06 Jifan Yu , Mengying Lu , Qingyang Zhong , Zijun Yao , Shangqing Tu , Zhengshan Liao , Xiaoya Li , Manli Li , Lei Hou , Hai-Tao Zheng , Juanzi Li , Jie Tang

Student learning activity in MOOCs can be viewed from multiple perspectives. We present a new organization of MOOC learner activity data at a resolution that is in between the fine granularity of the clickstream and coarse organizations…

Human-Computer Interaction · Computer Science 2018-12-17 Yanbang Wang , Nancy Law , Erik Hemberg , Una-May O'Reilly

Classroom observation -- one of the most effective methods for teacher development -- remains limited due to high costs and a shortage of expert coaches. We present ClassMind, an AI-driven classroom observation system that integrates…

Human-Computer Interaction · Computer Science 2025-09-23 Ao Qu , Yuxi Wen , Jiayi Zhang , Yunge Wen , Yibo Zhao , Alok Prakash , Andrés F. Salazar-Gómez , Paul Pu Liang , Jinhua Zhao

The aim of this study was to predict university students' learning performance using different sources of data from an Intelligent Tutoring System. We collected and preprocessed data from 40 students from different multimodal sources:…

Computers and Society · Computer Science 2024-03-13 W. Chango , R. Cerezo , M. Sanchez-Santillan , R. Azevedo , C. Romero

The Web has enabled one of the most visible recent developments in education---the deployment of massive open online courses. With their global reach and often staggering enrollments, MOOCs have the potential to become a major new mechanism…

Social and Information Networks · Computer Science 2014-03-17 Ashton Anderson , Daniel Huttenlocher , Jon Kleinberg , Jure Leskovec

We present a platform for student monitoring in remote education consisting of a collection of sensors and software that capture biometric and behavioral data. We define a collection of tasks to acquire behavioral data that can be useful…

Human-Computer Interaction · Computer Science 2019-12-11 Javier Hernandez-Ortega , Roberto Daza , Aythami Morales , Julian Fierrez , Javier Ortega-Garcia

In this article, we present a novel multimodal feedback framework called MOSAIC-F, an acronym for a data-driven Framework that integrates Multimodal Learning Analytics (MMLA), Observations, Sensors, Artificial Intelligence (AI), and…

Human-Computer Interaction · Computer Science 2025-06-11 Alvaro Becerra , Daniel Andres , Pablo Villegas , Roberto Daza , Ruth Cobos

We present BadgeX, a novel system integrating lightweight wearable IoT devices (smart badges/smartphones) with Large Language Models (LLMs) to enable real-time collaborative learning analytics. The system captures multimodal sensor data…

Human-Computer Interaction · Computer Science 2026-04-07 Zaibei Li , Shunpei Yamaguchi , Qiuchi Li , Daniel Spikol

Online education platforms have experienced explosive growth over the past decade, generating massive volumes of user-generated content in the form of reviews, ratings, and behavioral logs. These heterogeneous signals provide unprecedented…

Graphics · Computer Science 2026-04-14 Arman Bekov , Azamat Nurgali

Multimodal data has become a crucial element in the realm of big data analytics, driving advancements in data exploration, data mining, and empowering artificial intelligence applications. To support high-quality retrieval for these…

Databases · Computer Science 2025-02-11 Ming Sheng , Shuliang Wang , Yong Zhang , Kaige Wang , Jingyi Wang , Yi Luo , Rui Hao

Despite remarkable advances in emotion recognition, they are severely restrained from either the essentially limited property of the employed single modality, or the synchronous presence of all involved multiple modalities. Motivated by…

Machine Learning · Computer Science 2019-07-25 Jing Han , Zixing Zhang , Zhao Ren , Björn Schuller

Mobile applications and other integration of information and communication technology (ICT) have become well-known in education to monitor teaching and learning activities. The analysis of student learning through evaluation is a growing…

Human-Computer Interaction · Computer Science 2022-02-08 Ronel B. Dayanghirang , Alexander A. Hernandez

While learning analytics dashboards (LADs) are the most common form of LA intervention, there is limited evidence regarding their impact on students learning outcomes. This systematic review synthesizes the findings of 38 research studies…

Human-Computer Interaction · Computer Science 2023-12-27 Rogers Kaliisa , Kamila Misiejuk , Sonsoles López-Pernas , Mohammad Khalil , Mohammed Saqr