English
Related papers

Related papers: MoodSmith: Enabling Mood-Consistent Multimedia for…

200 papers

In human communication, both verbal and non-verbal cues play a crucial role in conveying emotions, intentions, and meaning beyond words alone. These non-linguistic information, such as facial expressions, eye contact, voice tone, and pitch,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Se Jin Park , Yeonju Kim , Hyeongseop Rha , Bella Godiva , Yong Man Ro

Emotions play a key role in human communication and public presentations. Human emotions are usually expressed through multiple modalities. Therefore, exploring multimodal emotions and their coherence is of great value for understanding…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Haipeng Zeng , Xingbo Wang , Aoyu Wu , Yong Wang , Quan Li , Alex Endert , Huamin Qu

Emotions, shaped by past experiences, significantly influence decision-making and goal pursuit. Traditional cognitive-behavioral techniques for personal development rely on mental imagery to envision ideal selves, but may be less effective…

Human-Computer Interaction · Computer Science 2025-04-10 Cathy Mengying Fang , Phoebe Chua , Samantha Chan , Joanne Leong , Andria Bao , Pattie Maes

Even though the emotional state is increasingly taken into account in scientific studies aimed at determining user experience of user acceptance, there are still only a few normalized tools. In this article, we decided to focus on mood…

Human-Computer Interaction · Computer Science 2019-02-11 Willy Yvart , Charles-Alexandre Delestage , Sylvie Leleu-Merviel

Understanding how diverse individuals and communities respond to persuasive messaging holds significant potential for advancing personalized and socially aware machine learning. While Large Vision and Language Models (VLMs) offer promise,…

AI is increasingly used to scale collective decision-making, but far less attention has been paid to how such systems can support procedural legitimacy, particularly the conditions shaping losers' consent: whether participants who do not…

Human-Computer Interaction · Computer Science 2026-04-08 Suyash Fulay , Prerna Ravi , Emily Kubin , Shrestha Mohanty , Michiel Bakker , Deb Roy

Multimodal sentiment analysis (MSA), which supposes to improve text-based sentiment analysis with associated acoustic and visual modalities, is an emerging research area due to its potential applications in Human-Computer Interaction (HCI).…

Multimedia · Computer Science 2022-09-07 Yihe Liu , Ziqi Yuan , Huisheng Mao , Zhiyun Liang , Wanqiuyue Yang , Yuanzhe Qiu , Tie Cheng , Xiaoteng Li , Hua Xu , Kai Gao

Emotion is essential in spoken communication, yet most existing frameworks in speech emotion modeling rely on predefined categories or low-dimensional continuous attributes, which offer limited expressive capacity. Recent advances in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-07 Tianhua Qi , Wenming Zheng , Björn W. Schuller , Zhaojie Luo , Haizhou Li

Advertisement videos (ads) play an integral part in the domain of Internet e-commerce as they amplify the reach of particular products to a broad audience or can serve as a medium to raise awareness about specific issues through concise…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Digbalay Bose , Rajat Hebbar , Tiantian Feng , Krishna Somandepalli , Anfeng Xu , Shrikanth Narayanan

Effective and safe human-machine collaboration requires the regulated and meaningful exchange of emotions between humans and artificial intelligence (AI). Current AI systems based on large language models (LLMs) can provide feedback that…

Computation and Language · Computer Science 2025-06-18 Xiuwen Wu , Hao Wang , Zhiang Yan , Xiaohan Tang , Pengfei Xu , Wai-Ting Siok , Ping Li , Jia-Hong Gao , Bingjiang Lyu , Lang Qin

Story generation aims to produce image sequences that depict coherent narratives while maintaining subject consistency across frames. Although existing methods have excelled in producing coherent and expressive stories, they remain largely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jingyuan Yang , Rucong Chen , Weibin Luo , Hui Huang

Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care. The ability to accurately and efficiently predict mood from easily collectible data has several important implications for the…

Emojis have become ubiquitous in online communication, serving as a universal medium to convey emotions and decorative elements. Their widespread use transcends language and cultural barriers, enhancing understanding and fostering more…

Computation and Language · Computer Science 2024-12-24 Rafid Ishrak Jahan , Heng Fan , Haihua Chen , Yunhe Feng

Young people's mental well-being is a global concern, with peer support playing a key role in daily emotional regulation. Conversational agents are increasingly viewed as promising tools for delivering accessible, personalised peer support,…

Human-Computer Interaction · Computer Science 2025-12-01 Ruoyu Wen , Xiaoli Wu , Kunal Gupta , Simon Hoermann , Mark Billinghurst , Alaeddin Nassani , Dwain Allan , Thammathip Piumsomboon

In this work, we study the association between song lyrics and mood through a data-driven analysis. Our data set consists of nearly one million songs, with song-mood associations derived from user playlists on the Spotify streaming…

Multimedia · Computer Science 2022-07-13 Shahrzad Naseri , Sravana Reddy , Joana Correia , Jussi Karlgren , Rosie Jones

AI companion chatbots are increasingly used for emotional support, with prior work in the domain predominantly documenting their mixed psychosocial impacts, including both increased emotional expression and heightened loneliness. However,…

Human-Computer Interaction · Computer Science 2026-03-25 Olivia Yan Huang , Monika Stodolska , Sharifa Sultana

In this work, we introduce Mozualization, a music generation and editing tool that creates multi-style embedded music by integrating diverse inputs, such as keywords, images, and sound clips (e.g., segments from various pieces of music or…

Human-Computer Interaction · Computer Science 2025-04-22 Wanfang Xu , Lixiang Zhao , Haiwen Song , Xinheng Song , Zhaolin Lu , Yu Liu , Min Chen , Eng Gee Lim , Lingyun Yu

Understanding sentiment in multimodal conversations is a complex yet crucial challenge toward building emotionally intelligent AI systems. The Multimodal Conversational Aspect-based Sentiment Analysis (MCABSA) Challenge invited participants…

Computation and Language · Computer Science 2025-12-30 Zhiqiang Gao , Shihao Gao , Zixing Zhang , Yihao Guo , Hongyu Chen , Jing Han

The ability to estimate current affective statuses of web users has considerable potential towards the realization of user-centric opportune services. However, determining the type of data to be used for such estimation as well as…

Computers and Society · Computer Science 2025-04-24 Tadashi Okoshi , Wataru Sasaki , Hiroshi Kawane , Kota Tsubouchi

Generative AI systems are increasingly capable of expressing emotions via text and imagery. Effective emotional expression will likely play a major role in the efficacy of AI systems -- particularly those designed to support human mental…