English
Related papers

Related papers: Conditioning LLMs with Emotion in Neural Machine T…

200 papers

The evolution of Neural Machine Translation (NMT) has been significantly influenced by six core challenges (Koehn and Knowles, 2017), which have acted as benchmarks for progress in this field. This study revisits these challenges, offering…

Computation and Language · Computer Science 2024-12-16 Jianhui Pang , Fanghua Ye , Longyue Wang , Dian Yu , Derek F. Wong , Shuming Shi , Zhaopeng Tu

Generating context-aware language that embodies diverse emotions is an important step towards building empathetic NLP systems. In this paper, we propose a formulation of modulated layer normalization -- a technique inspired by computer…

Computation and Language · Computer Science 2021-08-19 Ruibo Liu , Jason Wei , Chenyan Jia , Soroush Vosoughi

Recent advances in multimodal large language models (MLLMs) have demonstrated remarkable multi- and cross-modal integration capabilities. However, their potential for fine-grained emotion understanding remains systematically underexplored.…

Human-Computer Interaction · Computer Science 2025-12-25 Jing Han , Zhiqiang Gao , Shihao Gao , Jialing Liu , Hongyu Chen , Zixing Zhang , Björn W. Schuller

Large Language Models (LLMs) have demonstrated superior abilities in tasks such as chatting, reasoning, and question-answering. However, standard LLMs may ignore crucial paralinguistic information, such as sentiment, emotion, and speaking…

Recently, Large Language Models (LLMs) have shown impressive language capabilities. While most of the existing LLMs have very unbalanced performance across different languages, multilingual alignment based on translation parallel data is an…

Computation and Language · Computer Science 2024-06-19 Shimao Zhang , Changjiang Gao , Wenhao Zhu , Jiajun Chen , Xin Huang , Xue Han , Junlan Feng , Chao Deng , Shujian Huang

The emergence of multimodal large language models (MLLMs) advances multimodal emotion recognition (MER) to the next level, from naive discriminative tasks to complex emotion understanding with advanced video understanding abilities and…

Human-Computer Interaction · Computer Science 2025-05-08 Zheng Lian , Haoyu Chen , Lan Chen , Haiyang Sun , Licai Sun , Yong Ren , Zebang Cheng , Bin Liu , Rui Liu , Xiaojiang Peng , Jiangyan Yi , Jianhua Tao

With strong expressive capabilities in Large Language Models(LLMs), generative models effectively capture sentiment structures and deep semantics, however, challenges remain in fine-grained sentiment classification across multi-lingual and…

Computation and Language · Computer Science 2024-11-28 Jie Wang , Yichen Wang , Zhilin Zhang , Jianhao Zeng , Kaidi Wang , Zhiyang Chen

Large language models (LLMs) have made significant progress in Emotional Intelligence (EI) and long-context modeling. However, existing benchmarks often overlook the fact that emotional information processing unfolds as a continuous…

Computation and Language · Computer Science 2026-01-13 Weichu Liu , Jing Xiong , Yuxuan Hu , Zixuan Li , Minghuan Tan , Ningning Mao , Hui Shen , Wendong Xu , Chaofan Tao , Min Yang , Chengming Li , Lingpeng Kong , Ngai Wong

This paper investigates the utilization of Large Language Models (LLMs) for solving complex linguistic puzzles, a domain requiring advanced reasoning and adept translation capabilities akin to human cognitive processes. We explore specific…

Computation and Language · Computer Science 2025-02-04 Zheng-Lin Lin , Yu-Fei Shih , Shu-Kai Hsieh

Human verbal communication includes affective messages which are conveyed through use of emotionally colored words. There has been a lot of research in this direction but the problem of integrating state-of-the-art neural language models…

Computation and Language · Computer Science 2017-04-25 Sayan Ghosh , Mathieu Chollet , Eugene Laksana , Louis-Philippe Morency , Stefan Scherer

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

Computation and Language · Computer Science 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Optimization algorithms and large language models (LLMs) enhance decision-making in dynamic environments by integrating artificial intelligence with traditional techniques. LLMs, with extensive domain knowledge, facilitate intelligent…

Neural and Evolutionary Computing · Computer Science 2024-05-17 Sen Huang , Kaixiang Yang , Sheng Qi , Rui Wang

Pretrained language models (PLMs) have produced substantial improvements in discourse-aware neural machine translation (NMT), for example, improved coherence in spoken language translation. However, the underlying reasons for their strong…

Computation and Language · Computer Science 2023-06-01 Zhihong Huang , Longyue Wang , Siyou Liu , Derek F. Wong

Despite achieving remarkable performance, machine translation (MT) research remains underexplored in terms of translating cultural elements in languages, such as idioms, proverbs, and colloquial expressions. This paper investigates the…

Computation and Language · Computer Science 2025-01-22 Minghan Wang , Viet-Thanh Pham , Farhad Moghimifar , Thuy-Trang Vu

This paper investigates the challenges of affect control in large language models (LLMs), focusing on their ability to express appropriate emotional states during extended dialogues. We evaluated state-of-the-art open-weight LLMs to assess…

Artificial Intelligence · Computer Science 2025-03-05 Gino Franco Fazzi , Julie Skoven Hinge , Stefan Heinrich , Paolo Burelli

Multimodal large language models (MLLMs) have been widely applied across various fields due to their powerful perceptual and reasoning capabilities. In the realm of psychology, these models hold promise for a deeper understanding of human…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jinpeng Hu , Hongchang Shi , Chongyuan Dai , Zhuo Li , Peipei Song , Meng Wang

Large Language Models are expressive tools that enable complex tasks of text understanding within Computational Social Science. Their versatility, while beneficial, poses a barrier for establishing standardized best practices within the…

Computers and Society · Computer Science 2024-08-05 Anders Giovanni Møller , Luca Maria Aiello

This paper proposes an effective emotional text-to-speech (TTS) system with a pre-trained language model (LM)-based emotion prediction method. Unlike conventional systems that require auxiliary inputs such as manually defined emotion…

Emotional prompting - the use of specific emotional diction in prompt engineering - has shown increasing promise in improving large language model (LLM) performance, truthfulness, and responsibility. However these studies have been limited…

Machine Learning · Computer Science 2026-04-10 Ameen Patel , Felix Lee , Kyle Liang , Joseph Thomas

Post-editing machine translation (MT) for creative texts, such as literature, requires balancing efficiency with the preservation of creativity and style. While neural MT systems struggle with these challenges, large language models (LLMs)…

Computation and Language · Computer Science 2025-04-07 Antonio Castaldo , Sheila Castilho , Joss Moorkens , Johanna Monti