English
Related papers

Related papers: Automatic Evaluation of Generative Models with Ins…

200 papers

Instruction tuning is an emergent paradigm in NLP wherein natural language instructions are leveraged with language models to induce zero-shot performance on unseen tasks. Instructions have been shown to enable good performance on unseen…

Computation and Language · Computer Science 2022-10-27 Prakhar Gupta , Cathy Jiao , Yi-Ting Yeh , Shikib Mehri , Maxine Eskenazi , Jeffrey P. Bigham

Instruction tuning is crucial for enabling Large Language Models (LLMs) to solve real-world tasks. Prior work has shown the effectiveness of instruction-tuning data synthesized solely from LLMs, raising a fundamental question: Do we still…

In the rapidly evolving field of Explainable Natural Language Processing (NLP), textual explanations, i.e., human-like rationales, are pivotal for explaining model predictions and enriching datasets with interpretable labels. Traditional…

Computation and Language · Computer Science 2025-11-12 Mahdi Dhaini , Juraj Vladika , Ege Erdogan , Zineb Attaoui , Gjergji Kasneci

Aligning large language models (LLMs) with human preferences is essential for safe and useful LLMs. Previous works mainly adopt reinforcement learning (RLHF) and direct preference optimization (DPO) with human feedback for alignment.…

Computation and Language · Computer Science 2023-10-03 Tianci Xue , Ziqi Wang , Heng Ji

Data annotated by humans is a source of knowledge by describing the peculiarities of the problem and therefore fueling the decision process of the trained model. Unfortunately, the annotation process for subjective natural language…

Computation and Language · Computer Science 2023-12-14 Kamil Kanclerz , Julita Bielaniewicz , Marcin Gruza , Jan Kocon , Stanisław Woźniak , Przemysław Kazienko

Multilingual large language models are designed, claimed, and expected to cater to speakers of varied languages. We hypothesise that the current practices of fine-tuning and evaluating these models may not perfectly align with this…

Computation and Language · Computer Science 2024-09-27 Pinzhen Chen , Simon Yu , Zhicheng Guo , Barry Haddow

Recent advances in natural language processing have leveraged instruction tuning to enhance Large Language Models (LLMs) for table-related tasks. However, previous works train different base models with different training data, lacking an…

Computation and Language · Computer Science 2025-01-27 Naihao Deng , Sheng Zhang , Henghui Zhu , Shuaichen Chang , Jiani Zhang , Alexander Hanbo Li , Chung-Wei Hang , Hideo Kobayashi , Yiqun Hu , Patrick Ng

Instruction-tuned Large Language Models (LLMs) have recently showcased remarkable advancements in their ability to generate fitting responses to natural language instructions. However, many current works rely on manual evaluation to judge…

Computation and Language · Computer Science 2024-02-06 Ansar Aynetdinov , Alan Akbik

Large "instruction-tuned" language models (i.e., finetuned to respond to instructions) have demonstrated a remarkable ability to generalize zero-shot to new tasks. Nevertheless, they depend heavily on human-written instruction data that is…

Computation and Language · Computer Science 2023-05-29 Yizhong Wang , Yeganeh Kordi , Swaroop Mishra , Alisa Liu , Noah A. Smith , Daniel Khashabi , Hannaneh Hajishirzi

Machine learning (ML) has significantly advanced text classification by enabling automated understanding and categorization of complex, unstructured textual data. However, accurately capturing nuanced linguistic patterns and contextual…

Computation and Language · Computer Science 2025-06-30 Peiheng Gao , Chen Yang , Ning Sun , Ričardas Zitikis

Large Language Models (LLMs) have demonstrated remarkable capabilities in open-ended text generation tasks. However, the inherent open-ended nature of these tasks implies that there is always room for improvement in the quality of model…

Computation and Language · Computer Science 2024-09-16 Ziqi Wang , Le Hou , Tianjian Lu , Yuexin Wu , Yunxuan Li , Hongkun Yu , Heng Ji

In the swiftly expanding domain of Natural Language Processing (NLP), the potential of GPT-based models for the financial sector is increasingly evident. However, the integration of these models with financial datasets presents challenges,…

Computation and Language · Computer Science 2023-11-14 Neng Wang , Hongyang Yang , Christina Dan Wang

Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these…

Instruction tuning of open-source large language models (LLMs) like LLaMA, using direct outputs from more powerful LLMs such as Instruct-GPT and GPT-4, has proven to be a cost-effective way to align model behaviors with human preferences.…

Computation and Language · Computer Science 2023-10-23 Haoran Li , Yiran Liu , Xingxing Zhang , Wei Lu , Furu Wei

A common and effective means for improving language model capabilities involves finetuning a ``student'' language model's parameters on generations from a more proficient ``teacher'' model. Termed ``synthetic data'', these generations are…

Instruction fine-tuning has recently emerged as a promising approach for improving the zero-shot capabilities of Large Language Models (LLMs) on new tasks. This technique has shown particular strength in improving the performance of…

Computation and Language · Computer Science 2023-07-13 Jiuding Sun , Chantal Shaib , Byron C. Wallace

Recent language models have achieved impressive performance in natural language tasks by incorporating instructions with task input during fine-tuning. Since all samples in the same natural language task can be explained with the same task…

Computation and Language · Computer Science 2023-11-14 Jin Myung Kwak , Minseon Kim , Sung Ju Hwang

Multilingual language models often perform unevenly across different languages due to limited generalization capabilities for some languages. This issue is significant because of the growing interest in making universal language models that…

Computation and Language · Computer Science 2024-10-11 Gürkan Soykan , Gözde Gül Şahin

Large Language Models (LLMs) have achieved remarkable success, where instruction tuning is the critical step in aligning LLMs with user intentions. In this work, we investigate how the instruction tuning adjusts pre-trained models with a…

Computation and Language · Computer Science 2024-04-05 Xuansheng Wu , Wenlin Yao , Jianshu Chen , Xiaoman Pan , Xiaoyang Wang , Ninghao Liu , Dong Yu

Instruction-tuned large language models have revolutionized natural language processing and have shown great potential in applications such as conversational agents. These models, such as GPT-4, can not only master language but also solve…

Computation and Language · Computer Science 2023-06-16 Yew Ken Chia , Pengfei Hong , Lidong Bing , Soujanya Poria