English
Related papers

Related papers: A Multimodal Machine Learning Framework for Teache…

200 papers

Vocal education in the music field is difficult to quantify due to the individual differences in singers' voices and the different quantitative criteria of singing techniques. Deep learning has great potential to be applied in music…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-01 Zhenyi Hou , Xu Zhao , Kejie Ye , Xinyu Sheng , Shanggerile Jiang , Jiajing Xia , Yitao Zhang , Chenxi Ban , Daijun Luo , Jiaxing Chen , Yan Zou , Yuchao Feng , Guangyu Fan , Xin Yuan

The promotion of the national education digitalization strategy has facilitated the development of teaching quality evaluation towards all-round, process-oriented, precise, and intelligent directions, inspiring explorations into new methods…

Computers and Society · Computer Science 2025-07-01 Cong Xie , Li Yang , Daben Wang , Jing Xiao

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

Human-Computer Interaction · Computer Science 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

Multimodal fusion is considered a key step in multimodal tasks such as sentiment analysis, emotion detection, question answering, and others. Most of the recent work on multimodal fusion does not guarantee the fidelity of the multimodal…

Machine Learning · Computer Science 2019-08-19 Navonil Majumder , Soujanya Poria , Gangeshwar Krishnamurthy , Niyati Chhaya , Rada Mihalcea , Alexander Gelbukh

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Student performance prediction is one of the most important subjects in educational data mining. As a modern technology, machine learning offers powerful capabilities in feature extraction and data modeling, providing essential support for…

Machine Learning · Computer Science 2025-02-06 Yawen Chen , Jiande Sun , Jinhui Wang , Liang Zhao , Xinmin Song , Linbo Zhai

Neural machine translation models usually adopt the teacher forcing strategy for training which requires the predicted sequence matches ground truth word by word and forces the probability of each prediction to approach a 0-1 distribution.…

Computation and Language · Computer Science 2019-12-03 Yang Feng , Wanying Xie , Shuhao Gu , Chenze Shao , Wen Zhang , Zhengxin Yang , Dong Yu

The increasing reliance on Large Language Models (LLMs) across various domains extends to education, where students progressively use generative AI as a tool for learning. While prior work has examined LLMs' mathematical ability, their…

Computation and Language · Computer Science 2026-01-21 Wei-Ling Hsu , Yu-Chien Tang , An-Zi Yen

Due to the complex nature of human emotions and the diversity of emotion representation methods in humans, emotion recognition is a challenging field. In this research, three input modalities, namely text, audio (speech), and video, are…

Artificial Intelligence · Computer Science 2024-02-13 Minoo Shayaninasab , Bagher Babaali

Evaluating teaching effectiveness at scale remains a persistent challenge for large universities, particularly within engineering programs that enroll tens of thousands of students. Traditional methods, such as manual review of student…

Computers and Society · Computer Science 2025-08-06 Jean-Francois Chamberland , Martin C. Carlisle , Arul Jayaraman , Krishna R. Narayanan , Sunay Palsole , Karan Watson

Reading fluency assessment is a critical component of literacy programmes, serving to guide and monitor early education interventions. Given the resource intensive nature of the exercise when conducted by teachers, the development of…

Computation and Language · Computer Science 2024-06-04 Mithilesh Vaidya , Binaya Kumar Sahoo , Preeti Rao

Precise video retrieval requires multi-modal correlations to handle unseen vocabulary and scenes, becoming more complex for lengthy videos where models must perform effectively without prior training on a specific dataset. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Mohamed Eltahir , Osamah Sarraj , Mohammed Bremoo , Mohammed Khurd , Abdulrahman Alfrihidi , Taha Alshatiri , Mohammad Almatrafi , Tanveer Hussain

The quality of human voice plays an important role across various fields like music, speech therapy, and communication, yet it lacks a universally accepted, objective definition. Instead, voice quality is referred to using subjective…

Sound · Computer Science 2024-10-15 Hira Dhamyal , Rita Singh

Machine translation (MT) of user-generated content (UGC) poses unique challenges, including handling slang, emotion, and literary devices like irony and sarcasm. Evaluating the quality of these translations is challenging as current metrics…

Computation and Language · Computer Science 2024-10-07 Shenbin Qian , Constantin Orăsan , Diptesh Kanojia , Félix do Carmo

A multi-modal emotion recognition method was established by combining two-channel convolutional neural network with ring network. This method can extract emotional information effectively and improve learning efficiency. The words were…

Artificial Intelligence · Computer Science 2023-11-21 Jiazhen Wang

The integration of new literature into the English curriculum remains a challenge since educators often lack scalable tools to rapidly evaluate readability and adapt texts for diverse classroom needs. This study proposes to address this gap…

Computation and Language · Computer Science 2024-12-03 Jordan J. Bird

AI tools, particularly large language modules, have recently proven their effectiveness within learning management systems and online education programmes. As feedback continues to play a crucial role in learning and assessment in schools,…

Human-Computer Interaction · Computer Science 2024-10-17 Ievgeniia Kuzminykh , Tareita Nawaz , Shihao Shenzhang , Bogdan Ghita , Jeffery Raphael , Hannan Xiao

Today, there have been many achievements in learning the association between voice and face. However, most previous work models rely on cosine similarity or L2 distance to evaluate the likeness of voices and faces following contrastive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chong Peng , Liqiang He , Dan Su

A main challenge in applying deep learning to music processing is the availability of training data. One potential solution is Multi-task Learning, in which the model also learns to solve related auxiliary tasks on additional datasets to…

Sound · Computer Science 2018-04-06 Daniel Stoller , Sebastian Ewert , Simon Dixon

Studies on emotion recognition (ER) show that combining lexical and acoustic information results in more robust and accurate models. The majority of the studies focus on settings where both modalities are available in training and…

Computation and Language · Computer Science 2019-06-26 Gustavo Aguilar , Viktor Rozgić , Weiran Wang , Chao Wang