English
Related papers

Related papers: Does Instruction Tuning Make LLMs More Consistent?

200 papers

As large language models rapidly evolve to support longer context, there is a notable disparity in their capability to generate output at greater lengths. Recent study suggests that the primary cause for this imbalance may arise from the…

Computation and Language · Computer Science 2024-10-16 Yingda Chen , Xingjun Wang , Jintao Huang , Yunlin Mao , Daoze Zhang , Yuze Zhao

Going beyond mere fine-tuning of vision-language models (VLMs), learnable prompt tuning has emerged as a promising, resource-efficient alternative. Despite their potential, effectively learning prompts faces the following challenges: (i)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Hari Chandana Kuchibhotla , Sai Srinivas Kancheti , Abbavaram Gowtham Reddy , Vineeth N Balasubramanian

Large language models (LLMs) are initially pretrained for broad capabilities and then finetuned with instruction-following datasets to improve their performance in interacting with humans. Despite advances in finetuning, a standardized…

Computation and Language · Computer Science 2024-07-30 Yihan Cao , Yanbin Kang , Chi Wang , Lichao Sun

Large language models (LLMs) are increasingly used in decision-making contexts, but when they present answers without signaling low confidence, users may unknowingly act on erroneous outputs. Prior work shows that LLMs maintain internal…

Computation and Language · Computer Science 2025-10-23 Mark Steyvers , Catarina Belem , Padhraic Smyth

Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in diverse tasks across different domains, with an increasing focus on improving their zero-shot generalization capabilities for unseen multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Ying Shen , Zhiyang Xu , Qifan Wang , Yu Cheng , Wenpeng Yin , Lifu Huang

We present symbol tuning - finetuning language models on in-context input-label pairs where natural language labels (e.g., "positive/negative sentiment") are replaced with arbitrary symbols (e.g., "foo/bar"). Symbol tuning leverages the…

Computation and Language · Computer Science 2024-01-02 Jerry Wei , Le Hou , Andrew Lampinen , Xiangning Chen , Da Huang , Yi Tay , Xinyun Chen , Yifeng Lu , Denny Zhou , Tengyu Ma , Quoc V. Le

In education, the capability of generating human-like text of Large Language Models (LLMs) inspired work on how they can increase the efficiency of learning and teaching. We study the affordability of these models for educators and students…

Computation and Language · Computer Science 2025-03-06 Bianca Raimondi , Saverio Giallorenzo , Maurizio Gabbrielli

Large language models (LLMs) are often fine-tuned for use on downstream tasks, though this can degrade capabilities learned during previous training. This phenomenon, often referred to as catastrophic forgetting, has important potential…

Computation and Language · Computer Science 2024-12-30 Megan Ung , Alicia Sun , Samuel J. Bell , Bhaktipriya Radharapu , Levent Sagun , Adina Williams

Instruction tuning in multimodal large language models (MLLMs) generally involves cooperative learning between a backbone LLM and a feature encoder of non-text input modalities. The major challenge is how to efficiently find the synergy…

Machine Learning · Computer Science 2025-09-10 Xintong Li , Junda Wu , Tong Yu , Yu Wang , Xiang Chen , Jiuxiang Gu , Lina Yao , Julian McAuley , Jingbo Shang

From the perspective of content safety issues, alignment has shown to limit large language models' (LLMs) harmful content generation. This intentional method of reinforcing models to not respond to certain user inputs seem to be present in…

Computation and Language · Computer Science 2023-08-28 Aibek Bekbayev , Sungbae Chun , Yerzat Dulat , James Yamazaki

Continual learning (CL) is a paradigm that aims to replicate the human ability to learn and accumulate knowledge continually without forgetting previous knowledge and transferring it to new tasks. Recent instruction tuning (IT) involves…

Computation and Language · Computer Science 2023-10-24 Zihan Zhang , Meng Fang , Ling Chen , Mohammad-Reza Namazi-Rad

Large language models (LLMs) struggle with precise length control, particularly in zero-shot settings. We conduct a comprehensive study evaluating LLMs' length control capabilities across multiple measures and propose practical methods to…

Computation and Language · Computer Science 2025-02-12 Fabian Retkowski , Alexander Waibel

Does prompting a large language model (LLM) like GPT-3 with explanations improve in-context learning? We study this question on two NLP tasks that involve reasoning over text, namely question answering and natural language inference. We…

Computation and Language · Computer Science 2022-10-14 Xi Ye , Greg Durrett

When adapting large language models (LLMs) to a specific downstream task, two primary approaches are commonly employed: (1) prompt engineering, often with in-context few-shot learning, leveraging the model's inherent generalization…

Machine Learning · Computer Science 2025-12-24 Jorg Bornschein , Clare Lyle , Yazhe Li , Amal Rannen-Triki , Xu Owen He , Razvan Pascanu

Recently, decomposing complex problems into simple subtasks--a crucial part of human-like natural planning--to solve the given problem has significantly boosted the performance of large language models (LLMs). However, leveraging such…

Computation and Language · Computer Science 2025-07-11 Mihir Parmar , Palash Goyal , Xin Liu , Yiwen Song , Mingyang Ling , Chitta Baral , Hamid Palangi , Tomas Pfister

Large language models (LLMs) consistently benefit from further fine-tuning on various tasks. However, we observe that directly tuning the Instruct (i.e., instruction-tuned) models often leads to marginal improvements and even performance…

Computation and Language · Computer Science 2025-09-29 Taiqiang Wu , Runming Yang , Jiayi Li , Pengfei Hu , Yik-Chung Wu , Ngai Wong , Yujiu Yang

The adaption of multilingual pre-trained LLMs into eloquent and helpful assistants is essential to facilitate their use across different language regions. In that spirit, we are the first to conduct an extensive study of the performance of…

Computation and Language · Computer Science 2024-10-11 Alexander Arno Weber , Klaudia Thellmann , Jan Ebert , Nicolas Flores-Herr , Jens Lehmann , Michael Fromm , Mehdi Ali

Instruction-tuned Large Language Models (LLMs) have recently showcased remarkable ability to generate fitting responses to natural language instructions. However, an open research question concerns the inherent biases of trained models and…

Computation and Language · Computer Science 2023-09-08 Patrick Haller , Ansar Aynetdinov , Alan Akbik

Large Language Models (LLMs) have demonstrated powerful capabilities that render them valuable in different applications, including conversational AI products. It is paramount to ensure the security and reliability of these products by…

Computation and Language · Computer Science 2025-01-23 Melissa Kazemi Rad , Huy Nghiem , Andy Luo , Sahil Wadhwa , Mohammad Sorower , Stephen Rawls

Large Language Models (LLMs) have demonstrated remarkable capabilities and have been extensively deployed across various domains, including recommender systems. Prior research has employed specialized \textit{prompts} to leverage the…

Information Retrieval · Computer Science 2024-04-02 Sichun Luo , Bowei He , Haohan Zhao , Wei Shao , Yanlin Qi , Yinya Huang , Aojun Zhou , Yuxuan Yao , Zongpeng Li , Yuanzhang Xiao , Mingjie Zhan , Linqi Song