English
Related papers

Related papers: Transformer-Driven Modeling of Variable Frequency …

200 papers

Recently, radical progress in machine learning (ML) has revolutionized computational materials science, enabling unprecedentedly rapid materials discovery and property prediction, but the quantum many-body problem -- which is the key to…

Materials Science · Physics 2025-07-09 Bowen Hou , Xian Xu , Jinyuan Wu , Diana Y. Qiu

This study investigates the task of dwell time prediction and proposes a Transformer framework based on interaction behavior modeling. The method first represents user interaction sequences on the interface by integrating dwell duration,…

Human-Computer Interaction · Computer Science 2025-12-22 Rui Liu , Runsheng Zhang , Shixiao Wang

Conversational engagement estimation is posed as a regression problem, entailing the identification of the favorable attention and involvement of the participants in the conversation. This task arises as a crucial pursuit to gain insights…

Student engagement plays a crucial role in the successful delivery of educational programs. Automated engagement measurement helps instructors monitor student participation, identify disengagement, and adapt their teaching strategies to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Sadaf Safa , Ali Abedi , Shehroz S. Khan

Understanding student behavior in the classroom is essential to improve both pedagogical quality and student engagement. Existing methods for predicting student engagement typically require substantial annotated data to model the diversity…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Ahmed Abdelkawy , Ahmed Elsayed , Asem Ali , Aly Farag , Thomas Tretter , Michael McIntyre

This study presents high-throughput, real-time multi-agent affective computing framework designed to enhance classroom learning through emotional state monitoring. As large classroom sizes and limited teacher student interaction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hai Nguyen , Hieu Dao , Hung Nguyen , Nam Vu , Cong Tran

The increasing adoption of smart classroom technologies in higher education has mainly focused on automating attendance, with limited attention given to students' emotional and cognitive engagement during lectures. This limits instructors'…

Artificial Intelligence · Computer Science 2026-01-14 Keith Ainebyona , Ann Move Oguti , Joseph Walusimbi , Ritah Kobusingye

Engagement detection in online learning environments is vital for improving student outcomes and personalizing instruction. We present ViBED-Net (Video-Based Engagement Detection Network), a novel deep learning framework designed to assess…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Prateek Gothwal , Deeptimaan Banerjee , Ashis Kumer Biswas

This paper introduces a new multi-modal model based on the Transformer architecture and tensor product fusion strategy, combining BERT's text vectors and ViT's image vectors to classify students' psychological conditions, with an accuracy…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Ao Xiang , Zongqing Qi , Han Wang , Qin Yang , Danqing Ma

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promising results in…

Machine Learning · Computer Science 2026-03-05 Hantong Feng , Yonggang Wu , Duxin Chen , Wenwu Yu

In this paper, we develop a novel mobility-aware transformer-driven tiered structure (MASSFormer) based cooperative spectrum sensing method that effectively models the spatio-temporal dynamics of user movements. Unlike existing methods, our…

Information Theory · Computer Science 2024-09-27 Dimpal Janu , Sandeep Mandia , Kuldeep Singh , Sandeep Kumar

Developing machine learning algorithms to understand person-to-person engagement can result in natural user experiences for communal devices such as Amazon Alexa. Among other cues such as voice activity and gaze, a person's audio-visual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-02 Srinivas Parthasarathy , Shiva Sundaram

Some group activities, such as team sports and choreographed dances, involve closely coupled interaction between participants. Here we investigate the tasks of inferring and predicting participant behavior, in terms of motion paths and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Bo Hu , Tat-Jen Cham

Understanding and enhancing student engagement through digital platforms is critical in higher education. This study introduces a methodology for quantifying engagement across an entire module using virtual learning environment (VLE)…

Computers and Society · Computer Science 2024-12-17 Laura J. Johnston , Jim E. Griffin , Ioanna Manolopoulou , Takoua Jendoubi

Predicting contextualised engagement in videos is a long-standing problem that has been popularly attempted by exploiting the number of views or the associated likes using different computational methods. The recent decade has seen a boom…

Artificial Intelligence · Computer Science 2022-01-19 Sujit Roy , Gnaneswara Rao Gorle , Vishal Gaur , Haider Raza , Shoaib Jameel

Engagement estimation plays a crucial role in understanding human social behaviors, attracting increasing research interests in fields such as affective computing and human-computer interaction. In this paper, we propose a Dialogue-Aware…

Human-Computer Interaction · Computer Science 2024-10-14 Jia Li , Yangchen Yu , Yin Chen , Yu Zhang , Peng Jia , Yunbo Xu , Ziqiang Li , Meng Wang , Richang Hong

In recent years, deep learning has achieved innovative advancements in various fields, including the analysis of human emotions and behaviors. Initiatives such as the Affective Behavior Analysis in-the-wild (ABAW) competition have been…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Seongjae Min , Junseok Yang , Sangjun Lim , Junyong Lee , Sangwon Lee , Sejoon Lim

Automatic detection of students' engagement in online learning settings is a key element to improve the quality of learning and to deliver personalized learning materials to them. Varying levels of engagement exhibited by students in an…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ali Abedi , Shehroz S. Khan

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

Machine Learning · Computer Science 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

While transformers have shown great potential on video recognition with their strong capability of capturing long-range dependencies, they often suffer high computational costs induced by the self-attention to the huge number of 3D tokens.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yuxuan Liang , Pan Zhou , Roger Zimmermann , Shuicheng Yan