English
Related papers

Related papers: Corpus Development for Affective Video Indexing

200 papers

Emotion detection is an established NLP task of demonstrated utility for text understanding. However, basic emotion detection leaves out key information, namely, who is experiencing the emotion in question. For example, it may be the…

Computation and Language · Computer Science 2022-02-17 Samira Zad , Joshuan Jimenez , Mark A. Finlayson

We provide a new non-invasive, easy-to-scale for large amounts of subjects and a remotely accessible method for (hidden) emotion detection from videos of human faces. Our approach combines face manifold detection for accurate location of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Juni Kim , Zhikang Dong , Eric Guan , Judah Rosenthal , Shi Fu , Miriam Rafailovich , Pawel Polak

Affective Recommender Systems are an emerging class of intelligent systems that aim to enhance personalization by aligning recommendations with users' affective states. Reflecting a growing interest, a number of surveys have been published…

Information Retrieval · Computer Science 2025-08-29 Tonmoy Hasan , Razvan Bunescu

Humans use a host of signals to infer the emotional state of others. In general, computer systems that leverage signals from multiple modalities will be more robust and accurate in the same task. We present a multimodal affect and context…

Human-Computer Interaction · Computer Science 2019-03-29 Daniel McDuff , Kael Rowan , Piali Choudhury , Jessica Wolk , ThuVan Pham , Mary Czerwinski

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

Multimedia · Computer Science 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

Emotion is a crucial phenomenon in the functioning of human beings in society. However, it remains a widely open subject, particularly in its textual manifestations. This paper examines an industrial corpus manually annotated following an…

Computation and Language · Computer Science 2025-09-03 Jonas Noblet

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi

Research into multi-modal perception, human cognition, behavior, and attention can benefit from high-fidelity content that may recreate real-life-like scenes when rendered on head-mounted displays. Moreover, aspects of audiovisual…

Image and Video Processing · Electrical Eng. & Systems 2022-12-29 Thomas Robotham , Ashutosh Singla , Olli S. Rummukainen , Alexander Raake , Emanuël A. P. Habets

Emotions play a key role in human communication and public presentations. Human emotions are usually expressed through multiple modalities. Therefore, exploring multimodal emotions and their coherence is of great value for understanding…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Haipeng Zeng , Xingbo Wang , Aoyu Wu , Yong Wang , Quan Li , Alex Endert , Huamin Qu

People come to social media to satisfy a variety of needs, such as being informed, entertained and inspired, or connected to their friends and community. Hence, to design a ranking function that gives useful and personalized post…

Social and Information Networks · Computer Science 2022-06-27 Jane Dwivedi-Yu , Yi-Chia Wang , Lijing Qin , Cristian Canton-Ferrer , Alon Y. Halevy

Rating a video based on its content is an important step for classifying video age categories. Movie content rating and TV show rating are the two most common rating systems established by professional committees. However, manually…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Fatih Cagatay Akyon , Alptekin Temizel

Understanding emotional signals in older adults is crucial for designing virtual assistants that support their well-being. However, existing affective computing models often face significant limitations: (1) limited availability of datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Josep Lopez Camunas , Cristina Bustos , Yanjun Zhu , Raquel Ros , Agata Lapedriza

Video Captioning is considered to be one of the most challenging problems in the field of computer vision. Video Captioning involves the combination of different deep learning models to perform object detection, action detection, and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Soheyla Amirian , Abolfazl Farahani , Hamid R. Arabnia , Khaled Rasheed , Thiab R. Taha

Emotion classification is often formulated as the task to categorize texts into a predefined set of emotion classes. So far, this task has been the recognition of the emotion of writers and readers, as well as that of entities mentioned in…

Computation and Language · Computer Science 2022-04-12 Enrica Troiano , Laura Oberländer , Maximilian Wegge , Roman Klinger

Affective computing aims to understand and model human emotions for computational systems. Within this field, speech emotion recognition (SER) focuses on predicting emotions conveyed through speech. While early SER systems relied on limited…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-25 Luz Martinez-Lucas , Pravin Mote , Abinay Reddy Naini , Mohammed Abdelwahab , Carlos Busso

Understanding the sentiment of a comment from a video or an image is an essential task in many applications. Sentiment analysis of a text can be useful for various decision-making processes. One such application is to analyse the popular…

Computation and Language · Computer Science 2021-06-09 Bharathi Raja Chakravarthi , Vigneshwaran Muralidaran , Ruba Priyadharshini , John P. McCrae

In this paper we present a preliminary study for designing interactive systems that are sensible to human emotions based on the body movements. To do so, we first review the literature on the various approaches for defining and…

Human-Computer Interaction · Computer Science 2007-10-04 Alexis Clay , Nadine Couture , Laurence Nigay

Understanding the emotional impact of videos is crucial for applications in content creation, advertising, and Human-Computer Interaction (HCI). Traditional affective computing methods rely on self-reported emotions, facial expression…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Akhila Yaragoppa , Siddharth

Recent advancements in video generation have witnessed significant progress, especially with the rapid advancement of diffusion models. Despite this, their deficiencies in physical cognition have gradually received widespread attention -…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Minghui Lin , Xiang Wang , Yishan Wang , Shu Wang , Fengqi Dai , Pengxiang Ding , Cunxiang Wang , Zhengrong Zuo , Nong Sang , Siteng Huang , Donglin Wang

This paper presents an innovative approach to address the problems researchers face in Emotion Aware Recommender Systems (EARS): the difficulty and cumbersome collecting voluminously good quality emotion-tagged datasets and an effective way…

Information Retrieval · Computer Science 2023-05-09 John Kalung Leung , Igor Griva , William G. Kennedy , Jason M. Kinser , Sohyun Park , Seo Young Lee