English
Related papers

Related papers: Make Silence Speak for Itself: a multi-modal learn…

200 papers

Audio Large Language Models (Audio LLMs) have demonstrated strong capabilities in integrating speech perception with language understanding. However, whether their internal representations align with human neural dynamics during…

Sound · Computer Science 2026-02-04 Haoyun Yang , Xin Xiao , Jiang Zhong , Yu Tian , Dong Xiaohua , Yu Mao , Hao Wu , Kaiwen Wei

The Temporal Sampling Framework (TSF) theorizes that the characteristic phonological difficulties of dyslexia are caused by an atypical oscillatory sampling at one or more temporal rates. The LEEDUCA study conducted a series of…

This report proposes a polyphonic sound event detection (SED) method for the DCASE 2021 Challenge Task 4. The proposed SED model consists of two stages: a mean-teacher model for providing target labels regarding weakly labeled or unlabeled…

Sound · Computer Science 2021-07-07 Nam Kyun Kim , Hong Kook Kim

The flipped classroom is a new pedagogical strategy that has been gaining increasing importance recently. Spoken discussion dialog commonly occurs in flipped classroom, which embeds rich information indicating processes and progression of…

Computers and Society · Computer Science 2025-09-22 Hang Su , Borislav Dzodzo , Changlun Li , Danyang Zhao , Hao Geng , Yunxiang Li , Sidharth Jaggi , Helen Meng

While differences in patterns of functional connectivity and neural synchronization have been reported between individuals on the autism spectrum and neurotypical peers at various age stages, these differences appear to be subtle and may…

Neurons and Cognition · Quantitative Biology 2025-07-15 Sungwoo Ahn , Leonid L Rubchinsky , Evie A Malaia

The study of student engagement has attracted growing interests to address problems such as low academic performance, disaffection, and high dropout rates. Existing approaches to measuring student engagement typically rely on survey-based…

Human-Computer Interaction · Computer Science 2020-07-24 Nan Gao , Wei Shao , Mohammad Saiedur Rahaman , Flora D. Salim

In this paper, we present an improved model for voicing silent speech, where audio is synthesized from facial electromyography (EMG) signals. To give our model greater flexibility to learn its own input features, we directly use EMG signals…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-22 David Gaddy , Dan Klein

AI-augmented classrooms generate rich teacher and student feedback before graded outcomes become available, yet these signals can be difficult to translate into timely instructional decisions. We propose an interpretable decision layer: a…

Artificial Intelligence · Computer Science 2026-05-29 Junsoo Park , Youssef Medhat , Htet Phyo Wai , Ploy Thajchayapong , Ashok K. Goel

Although cognitive science has discovered several methods for increasing the learning of complex skills, such as physics problem solving, detailed examination of verbal protocols suggests there is still room for improvement. Basically,…

Physics Education · Physics 2009-09-29 Robert G. M. Hausmann , Brett van de Sande , Kurt VanLehn

Auditory processing difficulties involve challenges in understanding speech in noisy environments despite normal hearing. However, the neural mechanisms remain unclear, and standardized diagnostic criteria are lacking. This study examined…

Neurons and Cognition · Quantitative Biology 2025-06-18 Azuki Onaya , Hiroki Tanaka

In current clinical practice, electroencephalograms (EEG) are reviewed and analyzed by well-trained neurologists to provide supports for therapeutic decisions. The way of manual reviewing is labor-intensive and error prone. Automatic and…

Signal Processing · Electrical Eng. & Systems 2019-06-07 Xinghua Yao , Qiang Cheng , Guo-Qiang Zhang

The purpose of this research is to study the possibility of identifying students, statistically, by analyzing their behavior in different consecutive activities. In this project, there are three different sorts of activities: animated…

Social and Information Networks · Computer Science 2019-04-05 Abdulelah Abuabat , Peter Brusilovsky

Major Depressive Disorder (MDD) is a highly prevalent mental health condition, and a deeper understanding of its neurocognitive foundations is essential for identifying how core functions such as emotional and self-referential processing…

As more and more face-to-face classes move to online environments, it becomes increasingly important to explore any emerging barriers to students' learning. This work focuses on characterizing student barriers to active learning in…

Human-Computer Interaction · Computer Science 2021-04-13 Reza Hadi Mogavi , Yankun Zhao , Ehsan Ul Haq , Pan Hui , Xiaojuan Ma

Speech comprehension is an involuntary task for the healthy human brain, yet the understanding of the mechanisms underlying this brain functionality remains obscure. In this paper, we aim to quantify the role of acoustic and semantic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-31 Sai Samrat Kankanala , Akshara Soman , Sriram Ganapathy

Reading comprehension, which has been defined as gaining an understanding of written text through a process of translating grapheme into meaning, is an important academic skill. Other language learning skills - writing, speaking and…

Computation and Language · Computer Science 2021-10-25 Santosh Kumar Barnwal

Understanding students' and teachers' verbal and non-verbal behaviours during instruction may help infer valuable information regarding the quality of teaching. In education research, there have been many studies that aim to measure…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Ömer Sümer , Peter Gerjets , Ulrich Trautwein , Enkelejda Kasneci

We present MDEAW, a multimodal database consisting of Electrodermal Activity (EDA) and Photoplethysmography (PPG) signals recorded during the exams for the course taught by the teacher at Eurecat Academy, Sabadell, Barcelona in order to…

Human-Computer Interaction · Computer Science 2022-07-15 Arijit Nandi , Fatos Xhafa , Laia Subirats , Santi Fort

At present, the educational data mining community lacks many tools needed for ensuring equitable ability estimation for Neurodivergent (ND) learners. On one hand, most learner models are susceptible to under-estimating ND ability since…

Computers and Society · Computer Science 2022-05-10 Niall Twomey , Sarah McMullan , Anat Elhalal , Rafael Poyiadzi , Luis Vaquero

Electroencephalography (EEG) signals are promising as alternatives to other biometrics owing to their protection against spoofing. Previous studies have focused on capturing individual variability by analyzing task/condition-specific EEG.…

Signal Processing · Electrical Eng. & Systems 2021-03-29 Mari Ganesh Kumar , Shrikanth Narayanan , Mriganka Sur , Hema A Murthy