English
Related papers

Related papers: Visually grounded emotion regulation via diffusion…

200 papers

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li

Automatic image captioning has recently approached human-level performance due to the latest advances in computer vision and natural language understanding. However, most of the current models can only generate plain factual descriptions…

Computer Vision and Pattern Recognition · Computer Science 2018-01-31 Quanzeng You , Hailin Jin , Jiebo Luo

Models for affective text generation have shown a remarkable progress, but they commonly rely only on basic emotion theories or valance/arousal values as conditions. This is appropriate when the goal is to create explicit emotion statements…

Computation and Language · Computer Science 2023-07-27 Yarik Menchaca Resendiz , Roman Klinger

Using deep neural networks as computational models to simulate cognitive process can provide key insights into human behavioral dynamics. Challenges arise when environments are highly dynamic, obscuring stimulus-behavior relationships.…

Artificial Intelligence · Computer Science 2025-05-28 Songlin Xu , Xinyu Zhang

Text-to-image diffusion models have achieved high visual fidelity, yet precise control over scene semantics and fine-grained affective tone remains challenging. Human visual affect arises from the rapid integration of contextual meaning,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Li He , Longtai Zhang , Wenqiang Zhang , Yan Wang , Lizhe Qi

Visual reconstruction algorithms are an interpretive tool that map brain activity to pixels. Past reconstruction algorithms employed brute-force search through a massive library to select candidate images that, when passed through an…

Neurons and Cognition · Quantitative Biology 2023-05-03 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Audio-driven emotional 3D facial animation encounters two significant challenges: (1) reliance on single-modal control signals (videos, text, or emotion labels) without leveraging their complementary strengths for comprehensive emotion…

Multimedia · Computer Science 2025-06-13 Kangwei Liu , Junwu Liu , Xiaowei Yi , Jinlin Guo , Yun Cao

Artificial intelligence (AI) systems power the world we live in. Deep neural networks (DNNs) are able to solve tasks in an ever-expanding landscape of scenarios, but our eagerness to apply these powerful models leads us to focus on their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Loris Giulivi , Mark James Carman , Giacomo Boracchi

Design inspiration is crucial for establishing the direction of a design as well as evoking feelings and conveying meanings during the conceptual design process. Many practice designers use text-based searches on platforms like Pinterest to…

Human-Computer Interaction · Computer Science 2024-07-18 Ye Wang , Nicole B. Damen , Thomas Gale , Voho Seo , Hooman Shayani

Cognitive Behavioral Therapy (CBT) is a proven approach for addressing the irrational thought patterns associated with mental health disorders, but its effectiveness relies on accurately identifying cognitive pathways to provide targeted…

Artificial Intelligence · Computer Science 2025-07-01 Bosubabu Sambana , Kondreddygari Archana , Suram Indhra Sena Reddy , Shaik Meethaigar Jameer Basha , Shaik Karishma

Reflexion is an AI-powered platform designed to enable structured emotional self-reflection at scale. By integrating real-time emotion detection, layered reflective prompting, and metaphorical storytelling generation, Reflexion empowers…

Human-Computer Interaction · Computer Science 2025-04-30 Shou-Tzu Han

While modern diffusion models excel at generating high-quality and diverse images, they still struggle with high-fidelity compositional and multimodal control, particularly when users simultaneously specify text prompts, subject references,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yusuf Dalva , Guocheng Gordon Qian , Maya Goldenberg , Tsai-Shien Chen , Kfir Aberman , Sergey Tulyakov , Pinar Yanardag , Kuan-Chieh Jackson Wang

Image reconstruction and captioning from brain activity evoked by visual stimuli allow researchers to further understand the connection between the human brain and the visual perception system. While deep generative models have recently…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Weijian Mai , Zhijun Zhang

Speech emotion conversion is the task of converting the expressed emotion of a spoken utterance to a target emotion while preserving the lexical content and speaker identity. While most existing works in speech emotion conversion rely on…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Navin Raj Prabhu , Bunlong Lay , Simon Welker , Nale Lehmann-Willenbrock , Timo Gerkmann

The Emotional Voice Conversion (EVC) aims to convert the discrete emotional state from the source emotion to the target for a given speech utterance while preserving linguistic content. In this paper, we propose regularizing emotion…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-31 Ashishkumar Gudmalwar , Ishan D. Biyani , Nirmesh Shah , Pankaj Wasnik , Rajiv Ratn Shah

Affective computing is an emerging interdisciplinary field where computational systems are developed to analyze, recognize, and influence the affective states of a human. It can generally be divided into two subproblems: affective…

Machine Learning · Computer Science 2022-02-23 Guangtao Nie , Yibing Zhan

Image generation based on diffusion models has demonstrated impressive capability, motivating exploration into diverse and specialized applications. Owing to the importance of emotion in advertising, emotion-oriented image generation has…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Guoli Jia , Junyao Hu , Xinwei Long , Kai Tian , Kaiyan Zhang , KaiKai Zhao , Ning Ding , Bowen Zhou

Vision-language models (VLMs) have shown strong performance on text-to-image retrieval benchmarks. However, bridging this success to real-world applications remains a challenge. In practice, human search behavior is rarely a one-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Diji Yang , Minghao Liu , Chung-Hsiang Lo , Yi Zhang , James Davis

With advancements in video generative AI models (e.g., SORA), creators are increasingly using these techniques to enhance video previsualization. However, they face challenges with incomplete and mismatched AI workflows. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Yiran Chen , Anyi Rao , Xuekun Jiang , Shishi Xiao , Ruiqing Ma , Zeyu Wang , Hui Xiong , Bo Dai

Generative AI has significantly changed industries by enabling text-driven image generation, yet challenges remain in achieving high-resolution outputs that align with fine-grained user preferences. Consequently, multi-round interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Kun Li , Jianhui Wang , Yangfan He , Xinyuan Song , Ruoyu Wang , Hongyang He , Wenxin Zhang , Jiaqi Chen , Keqin Li , Sida Li , Miao Zhang , Tianyu Shi , Xueqian Wang