English
Related papers

Related papers: Personalized Steering of Large Language Models: Ve…

200 papers

Multimodal Large Language Models (MLLMs) often exhibit significant modality preference, which is a tendency to favor one modality over another. Depending on the input, they may over-rely on linguistic priors relative to visual evidence, or…

Machine Learning · Computer Science 2026-02-16 Zihan Huang , Xintong Li , Rohan Surana , Tong Yu , Rui Wang , Julian McAuley , Jingbo Shang , Junda Wu

Precise control over language model generation is vital for ensuring both safety and reliability. Although prompt engineering and steering are commonly used to intervene in model behaviors, the vast number of parameters in models often…

Computation and Language · Computer Science 2025-06-04 Mengru Wang , Ziwen Xu , Shengyu Mao , Shumin Deng , Zhaopeng Tu , Huajun Chen , Ningyu Zhang

Large Language Models (LLMs) are rapidly reshaping machine translation (MT), particularly by introducing instruction-following, in-context learning, and preference-based alignment into what has traditionally been a supervised…

Computation and Language · Computer Science 2026-04-29 Baban Gain , Dibyanayan Bandyopadhyay , Asif Ekbal , Trilok Nath Singh

Self-preference is a fundamental feature of biological organisms. Since large language models (LLMs) lack sentience, they might be expected to avoid such distortions. Yet, across 72 experiments and ~41,000 queries, we discovered massive…

Artificial Intelligence · Computer Science 2026-05-20 Steven A. Lehr , Mary Cipperman , Mahzarin R. Banaji

Large Language Models (LLMs) are increasingly positioned as decision engines for hiring, healthcare, and economic judgment, yet real-world human judgment reflects a balance between rational deliberation and emotion-driven bias. If LLMs are…

Aligning Large Language Models (LLMs) with human values and away from undesirable behaviors (such as hallucination) has become increasingly important. Recently, steering LLMs towards a desired behavior via activation editing has emerged as…

Computation and Language · Computer Science 2025-03-21 Anmol Goel , Yaxi Hu , Iryna Gurevych , Amartya Sanyal

Auto-evaluation is crucial for assessing response quality and offering feedback for model development. Recent studies have explored training large language models (LLMs) as generative judges to evaluate and critique other models' outputs.…

Computation and Language · Computer Science 2025-09-15 Peifeng Wang , Austin Xu , Yilun Zhou , Caiming Xiong , Shafiq Joty

Latent space steering methods provide a practical approach to controlling large language models by applying steering vectors to intermediate activations, guiding outputs toward desired behaviors while avoiding retraining. Despite their…

Machine Learning · Computer Science 2026-01-13 Shawn Im , Sharon Li

Recent advances in large language models (LLMs) have sparked growing interest in integrating language-driven techniques into trajectory prediction. By leveraging their semantic and reasoning capabilities, LLMs are reshaping how autonomous…

Computation and Language · Computer Science 2025-10-08 Yi Xu , Ruining Yang , Yitian Zhang , Jianglin Lu , Mingyuan Zhang , Yizhou Wang , Lili Su , Yun Fu

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often…

Computation and Language · Computer Science 2025-05-23 Jing Ye , Lu Xiang , Yaping Zhang , Chengqing Zong

Human preference alignment is critical in building powerful and reliable large language models (LLMs). However, current methods either ignore the multi-dimensionality of human preferences (e.g. helpfulness and harmlessness) or struggle with…

Machine Learning · Computer Science 2024-10-14 Xingzhou Lou , Junge Zhang , Jian Xie , Lifeng Liu , Dong Yan , Kaiqi Huang

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

Computer Science and Game Theory · Computer Science 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino

Personality manipulation in large language models (LLMs) is increasingly applied in customer service and agentic scenarios, yet its mechanisms and trade-offs remain unclear. We present a systematic study of personality control using the Big…

Computation and Language · Computer Science 2025-09-08 Gunmay Handa , Zekun Wu , Adriano Koshiyama , Philip Treleaven

While Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, aligning these models with varying human preferences across multiple objectives remains a significant challenge…

Computation and Language · Computer Science 2025-11-17 Biao Liu , Ning Xu , Junming Yang , Xin Geng

Activation steering methods enable inference-time control of large language model (LLM) behavior without retraining, but current approaches face a fundamental trade-off: sample-efficient methods suboptimally capture steering signals from…

Machine Learning · Computer Science 2026-03-09 Kartik Sharma , Rakshit S. Trivedi

We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhancing recommender systems with logical reasoning abilities…

Information Retrieval · Computer Science 2024-08-13 Jiachen Zhu , Jianghao Lin , Xinyi Dai , Bo Chen , Rong Shan , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

Aligning Large Language Models (LLMs) with general human preferences has been proved crucial in improving the interaction quality between LLMs and human. However, human values are inherently diverse among different individuals, making it…

Computation and Language · Computer Science 2024-12-31 Jianfei Zhang , Jun Bai , Bei Li , Yanmeng Wang , Rumei Li , Chenghua Lin , Wenge Rong

Recent advances in Large Language Models (LLMs) have opened new avenues for sequential recommendation by enabling natural language reasoning over user behavior sequences. A common approach formulates recommendation as a language modeling…

Information Retrieval · Computer Science 2026-04-08 Yu Wang , Yonghui Yang , Le Wu , Yi Zhang , Fei Liu , Richang Hong

Large Language Models (LLMs) have demonstrated remarkable potential in handling complex reasoning tasks by generating step-by-step rationales.Some methods have proven effective in boosting accuracy by introducing extra verifiers to assess…

Computation and Language · Computer Science 2024-07-02 Mingqian He , Yongliang Shen , Wenqi Zhang , Zeqi Tan , Weiming Lu

Recent advancements in LLMs have revolutionized motion generation models in embodied applications. While LLM-type auto-regressive motion generation models benefit from training scalability, there remains a discrepancy between their token…

Artificial Intelligence · Computer Science 2025-03-27 Ran Tian , Kratarth Goel