中文
相关论文

相关论文: Towards LLM-centric Affective Visual Customization…

200 篇论文

Emotional Support Conversation (ESC) aims to provide empathetic and effective emotional assistance through dialogue, addressing the growing demand for mental health support. This paper presents our solution for the NLPCC 2025 Task 8 ESC…

人工智能 · 计算机科学 2025-12-12 Shiquan Wang , Ruiyu Fang , Zhongjiang He , Shuangyong Song , Yongxiang Li

Language-based object detection (LOD) aims to align visual objects with language expressions. A large amount of paired data is utilized to improve LOD model generalizations. During the training process, recent studies leverage…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Yuming Chen , Jiangyan Feng , Haodong Zhang , Lijun Gong , Feng Zhu , Rui Zhao , Qibin Hou , Ming-Ming Cheng , Yibing Song

Accurately predicting individual aesthetic evaluation for images is a fundamental challenge for AI. Various deep learning (DL)-based models have been proposed for this task, training on image evaluation data to extract objective low-level…

人工智能 · 计算机科学 2026-05-15 Yoshia Abe , Tatsuya Daikoku , Yasuo Kuniyoshi

In recent years, large-scale pre-trained multimodal models (LMMs) generally emerge to integrate the vision and language modalities, achieving considerable success in multimodal tasks, such as text-image classification. The growing size of…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Xinyao Yu , Hao Sun , Zeyu Ling , Ziwei Niu , Zhenjia Bai , Rui Qin , Yen-Wei Chen , Lanfen Lin

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

人机交互 · 计算机科学 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

Convolutional Neural Networks are particularly suited for image analysis tasks, such as Image Classification, Object Recognition or Image Segmentation. Like all Artificial Neural Networks, however, they are "black box" models, and suffer…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Youssef Doulfoukar , Laurent Mertens , Joost Vennekens

Recent breakthroughs in large multimodal models (LMMs) have significantly advanced both text-to-image (T2I) generation and image-to-text (I2T) interpretation. However, many generated images still suffer from issues related to perceptual…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Jiarui Wang , Huiyu Duan , Yu Zhao , Juntong Wang , Guangtao Zhai , Xiongkuo Min

This paper aims to bridge the affective gap between image content and the emotional response of the viewer it elicits by using High-Level Concepts (HLCs). In contrast to previous work that relied solely on low-level features or used…

计算机视觉与模式识别 · 计算机科学 2017-05-09 Afsheen Rafaqat Ali , Usman Shahid , Mohsen Ali , Jeffrey Ho

Artificial Intelligence (AI) has demonstrated significant capabilities in various fields, and in areas such as human-computer interaction (HCI), embodied intelligence, and the design and animation of virtual digital humans, both…

计算与语言 · 计算机科学 2024-11-19 Yingjie Zhou , Zicheng Zhang , Jiezhang Cao , Jun Jia , Yanwei Jiang , Farong Wen , Xiaohong Liu , Xiongkuo Min , Guangtao Zhai

Emotion plays an important role in human cognition and performance. Motivated by this, we investigate whether analogous emotional signals can shape the behavior of large language models (LLMs) and agents. Existing emotion-aware studies…

人工智能 · 计算机科学 2026-04-02 Moran Sun , Tianlin Li , Yuwei Zheng , Zhenhong Zhou , Aishan Liu , Xianglong Liu , Yang Liu

Most existing vision-language pre-training (VLP) approaches adopt cross-modal masked language modeling (CMLM) to learn vision-language associations. However, we find that CMLM is insufficient for this purpose according to our observations:…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Yunhao Gou , Tom Ko , Hansi Yang , James Kwok , Yu Zhang , Mingxuan Wang

Emotions conveyed through voice and face shape engagement and context in human AI interaction. Despite rapid progress in omni modal large language models, the holistic evaluation of emotional reasoning with audiovisual cues remains limited.…

Mechanistic interpretability has revealed how concepts are encoded in large language models (LLMs), but emotional content remains poorly understood at the mechanistic level. We study whether LLMs process emotional valence through dedicated…

计算与语言 · 计算机科学 2026-05-08 Sohan Venkatesh

Emotion recognition based on body movements is vital in human-computer interaction. However, existing emotion recognition methods predominantly focus on enhancing classification accuracy, often neglecting the provision of textual…

人机交互 · 计算机科学 2024-12-23 Haifeng Lu , Jiuyi Chen , Feng Liang , Mingkui Tan , Runhao Zeng , Xiping Hu

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often…

计算与语言 · 计算机科学 2025-05-23 Jing Ye , Lu Xiang , Yaping Zhang , Chengqing Zong

Predicting affect in unconstrained environments remains a fundamental challenge in human-centered AI. While deep neural embeddings dominate contemporary approaches, they often lack interpretability and limit expert-driven refinement. We…

计算与语言 · 计算机科学 2026-04-09 Kosmas Pinitas , Ilias Maglogiannis

Empathetic and coherent responses are critical in auto-mated chatbot-facilitated psychotherapy. This study addresses the challenge of enhancing the emotional and contextual understanding of large language models (LLMs) in psychiatric…

计算与语言 · 计算机科学 2025-03-12 Abdur Rasool , Muhammad Irfan Shahzad , Hafsa Aslam , Vincent Chan , Muhammad Ali Arshad

Sentiment and emotion understanding are essential to applications such as human-computer interaction and depression detection. While Multimodal Large Language Models (MLLMs) demonstrate robust general capabilities, they face considerable…

计算与语言 · 计算机科学 2025-07-08 Ao Li , Longwei Xu , Chen Ling , Jinghui Zhang , Pengwei Wang

As the demand for emotional intelligence in large language models (LLMs) grows, a key challenge lies in understanding the internal mechanisms that give rise to emotional expression and in controlling emotions in generated text. This study…

计算与语言 · 计算机科学 2025-10-14 Chenxi Wang , Yixuan Zhang , Ruiji Yu , Yufei Zheng , Lang Gao , Zirui Song , Zixiang Xu , Gus Xia , Huishuai Zhang , Dongyan Zhao , Xiuying Chen

Technological advancements in web platforms allow people to express and share emotions towards textual write-ups written and shared by others. This brings about different interesting domains for analysis; emotion expressed by the writer and…

计算与语言 · 计算机科学 2025-03-12 Anoop Kadan , Deepak P. , Manjary P. Gangan , Savitha Sam Abraham , Lajish V. L