English
Related papers

Related papers: IHEval: Evaluating Language Models on Following th…

200 papers

Instruction hierarchy (IH) defines how LLMs prioritize system, developer, user, and tool instructions under conflict, providing a concrete, trust-ordered policy for resolving instruction conflicts. IH is key to defending against jailbreaks,…

One of the key strengths of Large Language Models (LLMs) is their ability to interact with humans by generating appropriate responses to given instructions. This ability, known as instruction-following capability, has established a…

Artificial Intelligence · Computer Science 2025-01-24 Hyeonseok Moon , Jaehyung Seo , Seungyoon Lee , Chanjun Park , Heuiseok Lim

Language models are trained to follow instructions, but they are also powerful pattern completers. What happens when these two objectives conflict? We construct conversations in which a user instruction to behave in a target way T (e.g.,…

Computation and Language · Computer Science 2026-05-21 Carolina Camassa , Derek Shiller

The automatic evaluation of instruction following typically involves using large language models (LLMs) to assess response quality. However, there is a lack of comprehensive evaluation of these LLM-based evaluators across two dimensions:…

Computation and Language · Computer Science 2024-10-10 Yixin Liu , Kejian Shi , Alexander R. Fabbri , Yilun Zhao , Peifeng Wang , Chien-Sheng Wu , Shafiq Joty , Arman Cohan

Language models deployed in high-stakes professional settings face conflicting demands from users, institutional authorities, and professional norms. How models act when these demands conflict reveals a principal hierarchy -- an implicit…

Artificial Intelligence · Computer Science 2026-05-13 Fangyi Yu , Nabeel Seedat , Jonathan Richard Schwarz , Andrew M. Bean

With the development and widespread application of large language models (LLMs), the new paradigm of "Model as Product" is rapidly evolving, and demands higher capabilities to address complex user needs, often requiring precise workflow…

Computation and Language · Computer Science 2025-09-17 Tao Zou , Xinghua Zhang , Haiyang Yu , Minzheng Wang , Fei Huang , Yongbin Li

Large Language Models (LLMs) have demonstrated impressive capabilities in creative tasks such as storytelling and E-mail generation. However, as LLMs are primarily trained on final text results rather than intermediate revisions, it might…

Computation and Language · Computer Science 2023-12-21 Lei Shu , Liangchen Luo , Jayakumar Hoskere , Yun Zhu , Yinxiao Liu , Simon Tong , Jindong Chen , Lei Meng

Instruction tuning plays a crucial role in shaping the outputs of language models (LMs) to desired styles. In this work, we propose a simple yet effective method, Instruction Modelling (IM), which trains LMs by applying a loss function to…

Computation and Language · Computer Science 2024-10-04 Zhengyan Shi , Adam X. Yang , Bin Wu , Laurence Aitchison , Emine Yilmaz , Aldo Lipani

Large language models (LLMs) could be valuable personal AI agents across various domains, provided they can precisely follow user instructions. However, recent studies have shown significant limitations in LLMs' instruction-following…

Artificial Intelligence · Computer Science 2025-03-31 Juyeon Heo , Miao Xiong , Christina Heinze-Deml , Jaya Narain

Instructional documents are rich sources of knowledge for completing various tasks, yet their unique challenges in conversational question answering (CQA) have not been thoroughly explored. Existing benchmarks have primarily focused on…

Computation and Language · Computer Science 2024-10-02 Shiwei Wu , Chen Zhang , Yan Gao , Qimeng Wang , Tong Xu , Yao Hu , Enhong Chen

Demand for mental health support through AI chatbots is surging, though current systems present several limitations, like sycophancy or overvalidation, and reinforcement of maladaptive beliefs. A core obstacle to the creation of better…

Computation and Language · Computer Science 2025-12-08 José Pombal , Maya D'Eon , Nuno M. Guerreiro , Pedro Henrique Martins , António Farinhas , Ricardo Rei

Large language models (LLMs) have shown tremendous success in following user instructions and generating helpful responses. Nevertheless, their robustness is still far from optimal, as they may generate significantly inconsistent responses…

Computation and Language · Computer Science 2024-03-25 Yukun Zhao , Lingyong Yan , Weiwei Sun , Guoliang Xing , Shuaiqiang Wang , Chong Meng , Zhicong Cheng , Zhaochun Ren , Dawei Yin

The Instruction Following (IF) ability measures how well Multi-modal Large Language Models (MLLMs) understand exactly what users are telling them and whether they are doing it right. Existing multimodal instruction following training data…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Shengyuan Ding , Shenxi Wu , Xiangyu Zhao , Yuhang Zang , Haodong Duan , Xiaoyi Dong , Pan Zhang , Yuhang Cao , Dahua Lin , Jiaqi Wang

In real-world task-oriented dialogue (TOD) settings, agents are required to strictly adhere to complex instructions while conducting multi-turn conversations with customers. These instructions are typically presented in natural language…

Computation and Language · Computer Science 2025-11-21 Sarik Ghazarian , Abhinav Gullapalli , Swair Shah , Anurag Beniwal , Nanyun Peng , Narayanan Sadagopan , Zhou Yu

Language Models (LMs) struggle with complex, interdependent instructions, particularly in high-stakes domains like finance where precision is critical. We introduce FIFE, a novel, high-difficulty benchmark designed to assess LM…

Machine Learning · Computer Science 2025-12-11 Glenn Matlin , Siddharth , Anirudh JM , Aditya Shukla , Yahya Hassan , Sudheer Chava

Evaluation of text generation to date has primarily focused on content created sequentially, rather than improvements on a piece of text. Writing, however, is naturally an iterative and incremental process that requires expertise in…

Computation and Language · Computer Science 2022-09-28 Jane Dwivedi-Yu , Timo Schick , Zhengbao Jiang , Maria Lomeli , Patrick Lewis , Gautier Izacard , Edouard Grave , Sebastian Riedel , Fabio Petroni

Despite significant achievements in improving the instruction-following capabilities of large language models (LLMs), the ability to process multiple potentially entangled or conflicting instructions remains a considerable challenge.…

As Large Language Models (LLMs) are deployed with increasing real-world responsibilities, it is important to be able to specify and constrain the behavior of these systems in a reliable manner. Model developers may wish to set explicit…

Artificial Intelligence · Computer Science 2024-03-11 Norman Mu , Sarah Chen , Zifan Wang , Sizhe Chen , David Karamardian , Lulwa Aljeraisy , Basel Alomair , Dan Hendrycks , David Wagner

Instruction-tuned large language models have revolutionized natural language processing and have shown great potential in applications such as conversational agents. These models, such as GPT-4, can not only master language but also solve…

Computation and Language · Computer Science 2023-06-16 Yew Ken Chia , Pengfei Hong , Lidong Bing , Soujanya Poria

Large Audio Language Models (LALMs), which couple acoustic perception with large language models (LLMs) to extract and understand diverse information from audio, have attracted intense interest from both academic and industrial communities.…

Sound · Computer Science 2025-10-28 Bohan Li , Wenbin Huang , Yuhang Qiu , Yiwei Guo , Hankun Wang , Zhihan Li , Jing Peng , Ziyang Ma , Xie Chen , Kai Yu