English
Related papers

Related papers: Can LLMs Separate Instructions From Data? And What…

200 papers

Large Language Models (LLMs) are susceptible to security and safety threats, such as prompt injection, prompt extraction, and harmful requests. One major cause of these vulnerabilities is the lack of an instruction hierarchy. Modern LLM…

Instruction fine-tuning has recently emerged as a promising approach for improving the zero-shot capabilities of Large Language Models (LLMs) on new tasks. This technique has shown particular strength in improving the performance of…

Computation and Language · Computer Science 2023-07-13 Jiuding Sun , Chantal Shaib , Byron C. Wallace

Instruction tuning plays a critical role in aligning large language models (LLMs) with human preference. Despite the vast amount of open instruction datasets, naively training a LLM on all existing instructions may not be optimal and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yulei Qin , Yuncheng Yang , Pengcheng Guo , Gang Li , Hang Shao , Yuchen Shi , Zihan Xu , Yun Gu , Ke Li , Xing Sun

In recent years, instruction tuning has gained increasing attention and emerged as a crucial technique to enhance the capabilities of Large Language Models (LLMs). To construct high-quality instruction datasets, many instruction processing…

Computation and Language · Computer Science 2024-06-25 Yixin Ou , Ningyu Zhang , Honghao Gui , Ziwen Xu , Shuofei Qiao , Yida Xue , Runnan Fang , Kangwei Liu , Lei Li , Zhen Bi , Guozhou Zheng , Huajun Chen

Instruction-tuned Large Language Models (LLMs) have achieved remarkable performance across various benchmark tasks. While providing instructions to LLMs for guiding their generations is user-friendly, assessing their instruction-following…

Computation and Language · Computer Science 2024-06-25 Rem Hida , Junki Ohmura , Toshiyuki Sekiya

Large Language Models (LLMs) annotated datasets are widely used nowadays, however, large-scale annotations often show biases in low-quality datasets. For example, Multiple-Choice Questions (MCQs) datasets with one single correct option is…

Computation and Language · Computer Science 2026-01-08 Zipeng Ling , Shuliang Liu , Yuehao Tang , Chen Huang , Gaoyang Jiang , Shenghong Fu , Junqi Yang , Yao Wan , Jiawan Zhang , Kejia Huang , Xuming Hu

Service providers of large language model (LLM) applications collect user instructions in the wild and use them in further aligning LLMs with users' intentions. These instructions, which potentially contain sensitive information, are…

Cryptography and Security · Computer Science 2024-07-03 Da Yu , Peter Kairouz , Sewoong Oh , Zheng Xu

Large language models (LLMs) have shown great potential as general-purpose AI assistants in various domains. To meet the requirements of different applications, LLMs are often customized by further fine-tuning. However, the powerful…

Machine Learning · Computer Science 2023-11-07 Xin Zhou , Yi Lu , Ruotian Ma , Tao Gui , Qi Zhang , Xuanjing Huang

Despite rapid advances in the capabilities of Large Language Models (LLMs), they continue to struggle with following relatively simple and unambiguous instructions, particularly when compositional structure is involved. Recent work suggests…

Computation and Language · Computer Science 2026-03-12 Prince Kumar , Rudra Murthy , Riyaz Bhat , Danish Contractor

The rapid integration of Large Language Models (LLMs) into software engineering practice is reshaping how software testing activities are performed. LLMs are increasingly used to support software testing. Consequently, software testing…

Software Engineering · Computer Science 2026-03-30 Peng Yang , Yunfeng Zhu , Chao Chang , Shengcheng Yu , Zhenyu Chen , Yong Tang

The integration of large language models (LLMs) into cyber security applications presents both opportunities and critical safety risks. We introduce CyberLLMInstruct, a dataset of 54,928 pseudo-malicious instruction-response pairs spanning…

Cryptography and Security · Computer Science 2025-09-18 Adel ElZemity , Budi Arief , Shujun Li

It is imperative for Large language models (LLMs) to follow instructions with elaborate requirements (i.e. Complex Instructions Following). Yet, it remains under-explored how to enhance the ability of LLMs to follow complex instructions…

Computation and Language · Computer Science 2024-06-19 Qianyu He , Jie Zeng , Qianxi He , Jiaqing Liang , Yanghua Xiao

The development of Large Language Models (LLMs) has created transformative opportunities for the financial industry, especially in the area of financial trading. However, how to integrate LLMs with trading systems has become a challenge. To…

Computational Engineering, Finance, and Science · Computer Science 2024-12-09 Yu Kang , Ge Wang , Xin Yang , Yuda Wang , Mingwen Liu

As research in large language models (LLMs) continues to accelerate, LLM-based evaluation has emerged as a scalable and cost-effective alternative to human evaluations for comparing the ever increasing list of models. This paper…

Computation and Language · Computer Science 2024-04-17 Zhiyuan Zeng , Jiatong Yu , Tianyu Gao , Yu Meng , Tanya Goyal , Danqi Chen

In the current landscape of large language models (LLMs), the process of instruction tuning serves as an essential step. Considering the high computing power overhead, data-efficient instruction tuning was proposed to reduce the training…

Computation and Language · Computer Science 2025-01-06 Qi Zhang , Yiming Zhang , Haobo Wang , Junbo Zhao

The ability of Large Language Models (LLMs) to precisely follow complex and fine-grained lexical instructions is a cornerstone of their utility and controllability. However, evaluating this capability remains a significant challenge.…

Computation and Language · Computer Science 2026-03-24 Huimin Ren , Yan Liang , Baiqiao Su , Chaobo Sun , Hengtong Lu , Kaike Zhang , Chen Wei

Extractive summarization can produce faithful summaries but often requires additional constraints such as a desired summary length. Traditional sentence compression models do not typically consider the constraints because of their…

Computation and Language · Computer Science 2024-06-21 Juseon-Do , Jingun Kwon , Hidetaka Kamigaito , Manabu Okumura

The pre-trained Large Language Models (LLMs) can be adapted for many downstream tasks and tailored to align with human preferences through fine-tuning. Recent studies have discovered that LLMs can achieve desirable performance with only a…

Computation and Language · Computer Science 2024-10-31 Yexiao He , Ziyao Wang , Zheyu Shen , Guoheng Sun , Yucong Dai , Yongkai Wu , Hongyi Wang , Ang Li

This paper surveys research works in the quickly advancing field of instruction tuning (IT), which can also be referred to as supervised fine-tuning (SFT)\footnote{In this paper, unless specified otherwise, supervised fine-tuning (SFT) and…

Computation and Language · Computer Science 2025-10-07 Shengyu Zhang , Linfeng Dong , Xiaoya Li , Sen Zhang , Xiaofei Sun , Shuhe Wang , Jiwei Li , Runyi Hu , Tianwei Zhang , Fei Wu , Guoyin Wang

Large language models (LLMs) enable researchers to analyze text at unprecedented scale and minimal cost. Researchers can now revisit old questions and tackle novel ones with rich data. We provide an econometric framework for realizing this…

Econometrics · Economics 2025-12-08 Jens Ludwig , Sendhil Mullainathan , Ashesh Rambachan