English
Related papers

Related papers: A Multimodal Framework for Explainable Evaluation …

200 papers

Accurately detecting sentiment polarity and intensity in product reviews and social media posts remains challenging due to informal and domain-specific language. To address this, we propose a novel hybrid lexicon-fuzzy-transformer framework…

Computation and Language · Computer Science 2025-12-11 Shayan Rokhva , Mousa Alizadeh , Maryam Abdollahi Shamami

This paper proposes an agent with particle swarm optimization (PSO) based on a Fuzzy Markup Language (FML) for students learning performance evaluation and educational applications, and the proposed agent is according to the response data…

Artificial Intelligence · Computer Science 2019-04-15 Chang-Shing Lee , Mei-Hui Wang , Chi-Shiang Wang , Olivier Teytaud , Jialin Liu , Su-Wei Lin , Pi-Hsia Hung

Multimodal sentiment analysis remains a challenging task due to the inherent heterogeneity across modalities. Such heterogeneity often manifests as asynchronous signals, imbalanced information between modalities, and interference from…

Multimedia · Computer Science 2025-11-26 Yadong Liu , Shangfei Wang

This paper discusses a fuzzy model for multi-level human emotions recognition by computer systems through keyboard keystrokes, mouse and touchscreen interactions. This model can also be used to detect the other possible emotions at the time…

Artificial Intelligence · Computer Science 2014-08-05 Kaveh Bakhtiyari , Hafizah Husain

Computer vision applications are omnipresent nowadays. The current paper explores the use of fuzzy logic in computer vision, stressing its role in handling uncertainty, noise, and imprecision in image data. Fuzzy logic is able to model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Adilet Yerkin , Ayan Igali , Elnara Kadyrgali , Maksat Shagyrov , Malika Ziyada , Muragul Muratbekova , Pakizar Shamoi

Modern ML methods excel when training data is IID, large-scale, and well labeled. Learning in less ideal conditions remains an open challenge. The sub-fields of few-shot, continual, transfer, and representation learning have made…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Matthew Wallingford , Aditya Kusupati , Keivan Alizadeh-Vahid , Aaron Walsman , Aniruddha Kembhavi , Ali Farhadi

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Machine learning models are widely used to support stealth assessment in digital learning environments. Existing approaches typically rely on abstracted gameplay log data, which may overlook subtle behavioral cues linked to learners'…

Machine Learning · Computer Science 2025-07-31 Clemens Witt , Thiemo Leonhardt , Nadine Bergner , Mareen Grillenberger

The basic aim of our study is to give a possible model for handling uncertain information. This model is worked out in the framework of DATALOG. At first the concept of fuzzy Datalog will be summarized, then its extensions for…

Artificial Intelligence · Computer Science 2010-04-08 Agnes Achs

Person identification systems often rely on audio, visual, or behavioral cues, but real-world conditions frequently present with missing or degraded modalities. To address this challenge, we propose a multimodal person identification…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Aref Farhadipour , Teodora Vukovic , Volker Dellwo , Petr Motlicek , Srikanth Madikeri

Multimodal learning enables neural networks to integrate information from heterogeneous sources, but active learning in this setting faces distinct challenges. These include missing modalities, differences in modality difficulty, and…

Machine Learning · Computer Science 2026-04-01 Dustin Eisenhardt , Yunhee Jeong , Florian Buettner

In this paper an accurate real-time sequence-based system for representation, recognition, interpretation, and analysis of the facial action units (AUs) and expressions is presented. Our system has the following characteristics: 1)…

Computer Vision and Pattern Recognition · Computer Science 2010-04-06 Mahmoud Khademi , Mohammad Hadi Kiapour , Mohammad T. Manzuri-Shalmani , Ali A. Kiaei

Multimodal Sentiment Analysis is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. The predominant approach, addressing this task, has been to develop sophisticated fusion…

Computation and Language · Computer Science 2020-10-20 Devamanyu Hazarika , Roger Zimmermann , Soujanya Poria

On the basis of network analysis, and within the context of modeling imprecision or vague information with fuzzy sets, we propose an innovative way to analyze, aggregate and apply this uncertain knowledge into community detection of…

Statistics Theory · Mathematics 2024-02-08 Inmaculada Gutiérrez , Daniel Gómez , Javier Castro , Rosa Espínola

As artificial intelligence systems increasingly operate in Real-world environments, the integration of multi-modal data sources such as vision, language, and audio presents both unprecedented opportunities and critical challenges for…

Machine Learning · Computer Science 2025-07-01 Sree Bhargavi Balija

This paper introduces a novel computational approach for analyzing nonverbal social behavior in educational settings. Integrating multimodal behavioral cues, including facial expressions, gesture intensity, and spatial dynamics, the model…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Uroš Petković , Jonas Frenkel , Olaf Hellwich , Rebecca Lazarides

Analyzing student behavior in educational scenarios is crucial for enhancing teaching quality and student engagement. Existing AI-based models often rely on classroom video footage to identify and analyze student behavior. While these…

Computers and Society · Computer Science 2025-03-11 Xian Gao , Jiacheng Ruan , Jingsheng Gao , Mingye Xie , Zongyun Zhang , Ting Liu , Yuzhuo Fu

In this paper we present the first results of a pilot experiment in the capture and interpretation of multimodal signals of human experts engaged in solving challenging chess problems. Our goal is to investigate the extent to which…

Human-Computer Interaction · Computer Science 2017-10-13 Thomas Guntz , Raffaella Balzarini , Dominique Vaufreydaz , James L. Crowley

Humans are skilled in reading the interlocutor's emotion from multimodal signals, including spoken words, simultaneous speech, and facial expressions. It is still a challenge to effectively decode emotions from the complex interactions of…

Machine Learning · Computer Science 2022-12-20 Feng Qiu , Chengyang Xie , Yu Ding , Wanzeng Kong

The optimization on the structure of process of information management under uncertain environment has attracted lots of attention from researchers around the world. Nevertheless, how to obtain accurate and rational evaluation from…

Artificial Intelligence · Computer Science 2024-12-30 Yuanpeng He