English
Related papers

Related papers: UltraIF: Advancing Instruction Following from the …

200 papers

Large language models (LLMs) have been significantly improved by instruction fine-tuning, but still lack transparency and the ability to utilize up-to-date knowledge and information. In this work, we propose search-augmented instruction…

Computation and Language · Computer Science 2023-06-27 Hongyin Luo , Yung-Sung Chuang , Yuan Gong , Tianhua Zhang , Yoon Kim , Xixin Wu , Danny Fox , Helen Meng , James Glass

Instruction tuning is a supervised fine-tuning approach that significantly improves the ability of large language models (LLMs) to follow human instructions. We propose SelfCodeAlign, the first fully transparent and permissive pipeline for…

Computation and Language · Computer Science 2024-11-04 Yuxiang Wei , Federico Cassano , Jiawei Liu , Yifeng Ding , Naman Jain , Zachary Mueller , Harm de Vries , Leandro von Werra , Arjun Guha , Lingming Zhang

Recent Large Language Models (LLMs) have demonstrated satisfying general instruction following ability. However, small LLMs with about 7B parameters still struggle fine-grained format following (e.g., JSON format), which seriously hinder…

Computation and Language · Computer Science 2025-02-10 Zhaoyang Wang , Jinqi Jiang , Huichi Zhou , Wenhao Zheng , Xuchao Zhang , Chetan Bansal , Huaxiu Yao

With the development of large language models, their ability to follow simple instructions has significantly improved. However, adhering to complex instructions remains a major challenge. Current approaches to generating complex…

Computation and Language · Computer Science 2025-02-28 Wei Liu , Yancheng He , Hui Huang , Chengwei Hu , Jiaheng Liu , Shilong Li , Wenbo Su , Bo Zheng

Large language models (LLMs) enable strong text generation, and in general there is a practical tradeoff between fine-tuning and prompt engineering. We introduce Simplify-This, a comparative study evaluating both paradigms for text…

Computation and Language · Computer Science 2026-01-12 Eilam Cohen , Itamar Bul , Danielle Inbar , Omri Loewenbach

Following the initial flourishing of large language models (LLMs), there has been a surge in proposed large vision-language models (LVLMs) that integrate LLMs with vision capabilities. However, it has been observed that LVLMs, after tuning…

Computation and Language · Computer Science 2025-12-30 Daiki Shiono , Shumpei Miyawaki , Ryota Tanaka , Jun Suzuki

Large language models (LLMs) have advanced general-purpose reasoning, showing strong performance across diverse tasks. However, existing methods often rely on implicit exploration, where the model follows stochastic and unguided reasoning…

Artificial Intelligence · Computer Science 2025-09-09 Jiaxiang Chen , Zhuo Wang , Mingxi Zou , Zhucong Li , Zhijian Zhou , Song Wang , Zenglin Xu

Large Language Models (LLMs) are expected to produce safe, helpful, and honest content during interaction with human users, but they frequently fail to align with such values when given flawed instructions, e.g., missing context, ambiguous…

Computation and Language · Computer Science 2025-08-07 Feifan Song , Bofei Gao , Yifan Song , Yi Liu , Weimin Xiong , Yuyang Song , Tianyu Liu , Guoyin Wang , Houfeng Wang

We introduce MIA-Bench, a new benchmark designed to evaluate multimodal large language models (MLLMs) on their ability to strictly adhere to complex instructions. Our benchmark comprises a diverse set of 400 image-prompt pairs, each crafted…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yusu Qian , Hanrong Ye , Jean-Philippe Fauconnier , Peter Grasch , Yinfei Yang , Zhe Gan

The recent advancement of large language models (LLMs) has been achieved through a combo of instruction tuning and human alignment. However, building manually crafted instruction datasets and performing human alignment become the bottleneck…

Computation and Language · Computer Science 2023-10-05 Tao Feng , Zifeng Wang , Jimeng Sun

With the availability of various instruction datasets, a pivotal challenge is how to effectively select and integrate these instructions to fine-tune large language models (LLMs). Previous research mainly focuses on selecting individual…

Computation and Language · Computer Science 2024-09-12 Hanyu Zhao , Li Du , Yiming Ju , Chengwei Wu , Tengfei Pan

Many applications of large language models (LLMs) require deductive reasoning, yet models frequently produce incorrect or redundant inference steps. We frame natural language inference as a search problem where the final answer is the valid…

Artificial Intelligence · Computer Science 2026-05-26 Andreas Opedal , Francesco Ignazio Re , Abulhair Saparov , Mrinmaya Sachan , Bernhard Schölkopf , Ryan Cotterell

Following the success of Large Language Models (LLMs), Large Multimodal Models (LMMs), such as the Flamingo model and its subsequent competitors, have started to emerge as natural steps towards generalist agents. However, interacting with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Mustafa Shukor , Alexandre Rame , Corentin Dancette , Matthieu Cord

With instruction tuning, Large Language Models (LLMs) can enhance their ability to adhere to commands. Diverging from most works focusing on data mixing, our study concentrates on enhancing the model's capabilities from the perspective of…

Computation and Language · Computer Science 2024-10-07 Jun Rao , Xuebo Liu , Lian Lian , Shengjun Cheng , Yunjie Liao , Min Zhang

Large Language Models (LLMs) have demonstrated remarkable capabilities and have been extensively deployed across various domains, including recommender systems. Prior research has employed specialized \textit{prompts} to leverage the…

Information Retrieval · Computer Science 2024-04-02 Sichun Luo , Bowei He , Haohan Zhao , Wei Shao , Yanlin Qi , Yinya Huang , Aojun Zhou , Yuxuan Yao , Zongpeng Li , Yuanzhang Xiao , Mingjie Zhan , Linqi Song

The emergence of Large Language Models (LLMs) has achieved tremendous success in the field of Natural Language Processing owing to diverse training paradigms that empower LLMs to effectively capture intricate linguistic patterns and…

Information Retrieval · Computer Science 2024-07-04 Lemei Zhang , Peng Liu , Yashar Deldjoo , Yong Zheng , Jon Atle Gulla

It is crucial for large language models (LLMs) to follow instructions that involve multiple constraints. However, it is an unexplored area to enhance LLMs' ability to follow soft constraints. To bridge the gap, we initially design a…

Computation and Language · Computer Science 2025-06-03 Qingyu Ren , Jie Zeng , Qianyu He , Jiaqing Liang , Yanghua Xiao , Weikang Zhou , Zeye Sun , Fei Yu

While large language models (LLMs) can solve PhD-level reasoning problems over long context inputs, they still struggle with a seemingly simpler task: following explicit length instructions-e.g., write a 10,000-word novel. Additionally,…

Computation and Language · Computer Science 2025-06-12 Wei Zhang , Zhenhong Zhou , Kun Wang , Junfeng Fang , Yuanhe Zhang , Rui Wang , Ge Zhang , Xavier Li , Li Sun , Lingjuan Lyu , Yang Liu , Sen Su

Large Language Models (LLMs) have shown impressive progress in mathematical reasoning. While data augmentation is promising to enhance mathematical problem-solving ability, current approaches are predominantly limited to instance-level…

Computation and Language · Computer Science 2025-06-17 Qizhi Pei , Lijun Wu , Zhuoshi Pan , Yu Li , Honglin Lin , Chenlin Ming , Xin Gao , Conghui He , Rui Yan

Large Language Models (LLMs) are nowadays extensively used for various types of software engineering tasks, primarily code generation. Previous research has shown how suitable prompt engineering could help developers in improving their code…