English
Related papers

Related papers: Facial Expression Recognition and Image Descriptio…

200 papers

In this report, we introduce Vintern-1B, a reliable 1-billion-parameters multimodal large language model (MLLM) for Vietnamese language tasks. By integrating the Qwen2-0.5B-Instruct language model with the InternViT-300M-448px visual model,…

Machine Learning · Computer Science 2024-08-26 Khang T. Doan , Bao G. Huynh , Dung T. Hoang , Thuc D. Pham , Nhat H. Pham , Quan T. M. Nguyen , Bang Q. Vo , Suong N. Hoang

Aspect-based sentiment analysis plays an essential role in natural language processing and artificial intelligence. Recently, researchers only focused on aspect detection and sentiment classification but ignoring the sub-task of detecting…

Computation and Language · Computer Science 2021-10-18 Kim Thi-Thanh Nguyen , Sieu Khai Huynh , Luong Luc Phan , Phuc Huynh Pham , Duc-Vu Nguyen , Kiet Van Nguyen

The human face conveys a significant amount of information. Through facial expressions, the face is able to communicate numerous sentiments without the need for verbalisation. Visual emotion recognition has been extensively studied.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Liam Schoneveld , Alice Othmani

Facial expression recognition has been an active research area over the past few decades, and it is still challenging due to the high intra-class variation. Traditional approaches for this problem rely on hand-crafted features such as SIFT,…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Shervin Minaee , Amirali Abdolrashidi

Emotion detection techniques have been applied to multiple cases mainly from facial image features and vocal audio features, of which the latter aspect is disputed yet not only due to the complexity of speech audio processing but also the…

Sound · Computer Science 2025-01-22 Qianhe Ouyang

In this work we design a neural network for recognizing emotions in speech, using the IEMOCAP dataset. Following the latest advances in audio analysis, we use an architecture involving both convolutional layers, for extracting high-level…

As robotics become increasingly integrated into construction workflows, their ability to interpret and respond to human behavior will be essential for enabling safe and effective collaboration. Vision-Language Models (VLMs) have emerged as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Hieu Bui , Nathaniel E. Chodosh , Arash Tavakoli

This paper presents a lightweight algorithm for feature extraction, classification of seven different emotions, and facial expression recognition in a real-time manner based on static images of the human face. In this regard, a Multi-Layer…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Mohammad Amin Haghpanah , Ehsan Saeedizade , Mehdi Tale Masouleh , Ahmad Kalhor

Complex emotion recognition is a cognitive task that has so far eluded the same excellent performance of other tasks that are at or above the level of human cognition. Emotion recognition through facial expressions is particularly difficult…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Angus Maiden , Bahareh Nakisa

Due to the complex nature of human emotions and the diversity of emotion representation methods in humans, emotion recognition is a challenging field. In this research, three input modalities, namely text, audio (speech), and video, are…

Artificial Intelligence · Computer Science 2024-02-13 Minoo Shayaninasab , Bagher Babaali

"How does the person in the bounding box feel?" Achieving human-level recognition of the apparent emotion of a person in real world situations remains an unsolved task in computer vision. Facial expressions are not enough: body pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Yasaman Etesam , Özge Nilay Yalçın , Chuxuan Zhang , Angelica Lim

In this paper, we present a comprehensive study on the application of YOLOv8, a state-of-the-art computer vision (CV) model, to the challenging problem of joint detection and classification of signals in a highly dynamic and congested RF…

Signal Processing · Electrical Eng. & Systems 2024-08-14 Xiwen Kang , Hua-mei Chen , Genshe Chen , Kuo-Chu Chang , Thomas M. Clemons

Emotional Artificial Intelligences are currently one of the most anticipated developments of AI. If successful, these AIs will be classified as one of the most complex, intelligent nonhuman entities as they will possess sentience, the…

Machine Learning · Computer Science 2023-10-17 Ashley Jisue Hong , David DiStefano , Sejal Dua

Emotion recognition plays an important role in human-computer interaction (HCI) and has been extensively studied for decades. Although tremendous improvements have been achieved for posed expressions, recognizing human emotions in…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Jie Cai , Zibo Meng , Ahmed Shehab Khan , Zhiyuan Li , James O'Reilly , Shizhong Han , Ping Liu , Min Chen , Yan Tong

In response to the COVID-19 pandemic, traditional physical classrooms have transitioned to online environments, necessitating effective strategies to ensure sustained student engagement. A significant challenge in online teaching is the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Rekha R Nair , Tina Babu , Pavithra K

This paper proposes a feature-based domain adaptation technique for identifying emotions in generic images, encompassing both facial and non-facial objects, as well as non-human components. This approach addresses the challenge of the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Puneet Kumar , Balasubramanian Raman

The expanding applications, utilized by more users, enhance hardware performance and further develop cloud systems for big data processing. This leads to numerous unexplored deep learning applications, especially in advanced computer vision…

Computational Engineering, Finance, and Science · Computer Science 2024-05-07 P. Veysi , M. Adeli , N. Peirov Naziri

Facial emotion recognition (FER) is significant for human-computer interaction such as clinical practice and behavioral description. Accurate and robust FER by computer models remains challenging due to the heterogeneity of human faces and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Yousif Khaireddin , Zhuofa Chen

Visual emotion expression plays an important role in audiovisual speech communication. In this work, we propose a novel approach to rendering visual emotion expression in speech-driven talking face generation. Specifically, we design an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-23 Sefik Emre Eskimez , You Zhang , Zhiyao Duan

Automatic affect recognition is a challenging task due to the various modalities emotions can be expressed with. Applications can be found in many domains including multimedia retrieval and human computer interaction. In recent years, deep…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Panagiotis Tzirakis , George Trigeorgis , Mihalis A. Nicolaou , Björn Schuller , Stefanos Zafeiriou