English
Related papers

Related papers: M2LADS Demo: A System for Generating Multimodal Le…

200 papers

In this article, we present a Web-based System called M2LADS, which supports the integration and visualization of multimodal data recorded in learning sessions in a MOOC in the form of Web-based Dashboards. Based on the edBB platform, the…

Human-Computer Interaction · Computer Science 2023-05-23 Álvaro Becerra , Roberto Daza , Ruth Cobos , Aythami Morales , Mutlu Cukurova , Julian Fierrez

In the article, we present a Web-based System called M2LADS, which supports the integration and visualization of multimodal data recorded in user experiences (UX) in a Learning Analytics (LA) system in the form of Web-based Dashboards.…

Human-Computer Interaction · Computer Science 2023-07-21 Álvaro Becerra , Roberto Daza , Ruth Cobos , Aythami Morales , Julian Fierrez

Wearable sensors, such as smartwatches, have become increasingly prevalent across domains like healthcare, sports, and education, enabling continuous monitoring of physiological and behavioral data. In the context of education, these…

Human-Computer Interaction · Computer Science 2025-12-03 Alvaro Becerra , Pablo Villegas , Ruth Cobos

In modern online learning, understanding and predicting student behavior is crucial for enhancing engagement and optimizing educational outcomes. This systematic review explores the integration of biosensors and Multimodal Learning…

Human-Computer Interaction · Computer Science 2025-09-10 Alvaro Becerra , Ruth Cobos , Charles Lang

Multimodal sentiment analysis aims to recognize people's attitudes from multiple communication channels such as verbal content (i.e., text), voice, and facial expressions. It has become a vibrant and important research topic in natural…

Machine Learning · Computer Science 2022-02-23 Xingbo Wang , Jianben He , Zhihua Jin , Muqiao Yang , Yong Wang , Huamin Qu

This work introduces an innovative method for estimating attention levels (cognitive load) using an ensemble of facial analysis techniques applied to webcam videos. Our method is particularly useful, among others, in e-learning…

Human-Computer Interaction · Computer Science 2024-08-15 Roberto Daza , Luis F. Gomez , Julian Fierrez , Aythami Morales , Ruben Tolosana , Javier Ortega-Garcia

In this paper, we present an approach in the Multimodal Learning Analytics field. Within this approach, we have developed a tool to visualize and analyze eye movement data collected during learning sessions in online courses. The tool is…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Miriam Navarro , Álvaro Becerra , Roberto Daza , Ruth Cobos , Aythami Morales , Julian Fierrez

Automatic analysis of teacher and student interactions could be very important to improve the quality of teaching and student engagement. However, despite some recent progress in utilizing multimodal data for teaching and learning…

Computers and Society · Computer Science 2022-12-07 Fangli Xu , Lingfei Wu , KP Thai , Carol Hsu , Wei Wang , Richard Tong

This work presents MAD (Multimodal Affection Dataset), a multimodal emotion dataset designed for affective computing and neurophysiological modeling. MAD is built upon synchronous collection of diverse physiological signals (EEG, ECG, EOG,…

Signal Processing · Electrical Eng. & Systems 2026-03-09 Shengwei Guo , Yunqing Qiao , Wenzhan Zhang , Bo Liu , Yong Wang , Guobing Sun

This work presents a new multimodal system for remote attention level estimation based on multimodal face analysis. Our multimodal approach uses different parameters and signals obtained from the behavior and physiological processes that…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Roberto Daza , Luis F. Gomez , Aythami Morales , Julian Fierrez , Ruben Tolosana , Ruth Cobos , Javier Ortega-Garcia

This work investigates the use of multimodal biometrics to detect distractions caused by smartphone use during tasks that require sustained attention, with a focus on computer-based online learning. Although the methods are applicable to…

Computers and Society · Computer Science 2025-06-25 Alvaro Becerra , Roberto Daza , Ruth Cobos , Aythami Morales , Mutlu Cukurova , Julian Fierrez

Brain-wide recordings of large-scale networks of neurons now provide an unprecedented view into how the brain drives behavior. However, brain activity contains both information directly related to behavior as well as the potential for many…

Neurons and Cognition · Quantitative Biology 2026-05-06 Eva Yezerets , En Yang , Misha B. Ahrens , Adam S. Charles

Machine learning models built on training data with multiple modalities can reveal new insights that are not accessible through unimodal datasets. For example, cardiac magnetic resonance images (MRIs) and electrocardiograms (ECGs) are both…

Machine Learning · Computer Science 2023-12-05 Bum Chul Kwon , Samuel Friedman , Kai Xu , Steven A Lubitz , Anthony Philippakis , Puneet Batra , Patrick T Ellinor , Kenney Ng

Learning Analytics Dashboards can be a powerful tool to support self-regulated learning in Digital Learning Environments and promote development of meta-cognitive skills, such as reflection. However, their effectiveness can be affected by…

Machine Learning · Computer Science 2025-11-18 Alina Deriyeva , Benjamin Paassen

We contribute a deep-learning-based method that assists in designing analytical dashboards for analyzing a data table. Given a data table, data workers usually need to experience a tedious and time-consuming process to select meaningful…

Human-Computer Interaction · Computer Science 2021-07-19 Aoyu Wu , Yun Wang , Mengyu Zhou , Xinyi He , Haidong Zhang , Huamin Qu , Dongmei Zhang

Advances in data collection enable the capture of rich patient-generated data: from passive sensing (e.g., wearables and smartphones) to active self-reports (e.g., cross-sectional surveys and ecological momentary assessments). Although…

Automatic Emotion Detection (ED) aims to build systems to identify users' emotions automatically. This field has the potential to enhance HCI, creating an individualised experience for the user. However, ED systems tend to perform poorly on…

Human-Computer Interaction · Computer Science 2023-07-27 Annanda Sousa , Karen Young , Mathieu D'aquin , Manel Zarrouk , Jennifer Holloway

This paper presents MOCAS, a multimodal dataset dedicated for human cognitive workload (CWL) assessment. In contrast to existing datasets based on virtual game stimuli, the data in MOCAS was collected from realistic closed-circuit…

Databases · Computer Science 2024-06-11 Wonse Jo , Ruiqi Wang , Su Sun , Revanth Krishna Senthilkumaran , Daniel Foti , Byung-Cheol Min

Managing fluid balance in dialysis patients is crucial, as improper management can lead to severe complications. In this paper, we propose a multimodal approach that integrates visual features from lung ultrasound images with clinical data…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Tianqi Yang , Nantheera Anantrasirichai , Oktay Karakuş , Marco Allinovi , Alin Achim

Video-based physiology, exemplified by remote photoplethysmography (rPPG), extracts physiological signals such as pulse and respiration by analyzing subtle changes in video recordings. This non-contact, real-time monitoring method holds…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Lei Yu , Jintao Fei , Xinyi Liu , Yang Yao , Jun Zhao , Guoxin Wang , Xin Li
‹ Prev 1 2 3 10 Next ›