English
Related papers

Related papers: Better Alignment with Instruction Back-and-Forth T…

200 papers

Instruction tuning improves the reasoning abilities of large language models (LLMs), with data quality and scalability being the crucial factors. Most instruction tuning data come from human crowd-sourcing or GPT-4 distillation. We propose…

Computation and Language · Computer Science 2024-05-24 Xiang Yue , Tuney Zheng , Ge Zhang , Wenhu Chen

The prevailing approach to aligning Large Language Models (LLMs) typically relies on human or AI feedback and assumes access to specific types of preference datasets. In our work, we question the efficacy of such datasets and explore…

Machine Learning · Computer Science 2024-03-19 Hao Sun

Large language models (LLMs) hold the promise of solving diverse tasks when provided with appropriate natural language prompts. However, prompting often leads models to make predictions with lower accuracy compared to finetuning a model…

Computation and Language · Computer Science 2024-08-13 Chenyang Zhao , Xueying Jia , Vijay Viswanathan , Tongshuang Wu , Graham Neubig

Instruction tuning is crucial for aligning Large Language Models (LLMs), yet the quality of instruction-following data varies significantly. While high-quality data is paramount, it is often scarce; conversely, abundant low-quality data is…

Computation and Language · Computer Science 2025-10-24 Zhijie Deng , Zhouan Shen , Ling Li , Yao Zhou , Zhaowei Zhu , Yanji He , Wei Wang , Jiaheng Wei

Instruction tuning improves the performance of large language models (LLMs), but it heavily relies on high-quality training data. Recently, LLMs have been used to synthesize instruction data using seed question-answer (QA) pairs. However,…

Computation and Language · Computer Science 2025-05-20 Chi Zhang , Huaping Zhong , Hongtao Li , Chengliang Chai , Jiawei Hong , Yuhao Deng , Jiacheng Wang , Tian Tan , Yizhou Yan , Jiantao Qiu , Ye Yuan , Guoren Wang , Conghui He , Lei Cao

This study underscores the pivotal role of syntax feedback in augmenting the syntactic proficiency of students. Recognizing the challenges faced by learners in mastering syntactic nuances, we introduce a specialized dataset named…

Computation and Language · Computer Science 2025-01-15 Kamyar Zeinalipour , Mehak Mehak , Fatemeh Parsamotamed , Marco Maggini , Marco Gori

In recent years, instruction fine-tuning (IFT) on large language models (LLMs) has garnered considerable attention to enhance model performance on unseen tasks. Attempts have been made on automatic construction and effective selection for…

Computation and Language · Computer Science 2024-10-25 Renhao Li , Minghuan Tan , Derek F. Wong , Min Yang

Autonomous agents powered by large language models (LLMs) have the potential to enhance human capabilities, assisting with digital tasks from sending emails to performing data analysis. The abilities of existing LLMs at such tasks are often…

Machine Learning · Computer Science 2025-01-22 Hongjin Su , Ruoxi Sun , Jinsung Yoon , Pengcheng Yin , Tao Yu , Sercan Ö. Arık

Large language models (LLMs) have demonstrated revolutionary capabilities in understanding complex contexts and performing a wide range of tasks. However, LLMs can also answer questions that are unethical or harmful, raising concerns about…

Cryptography and Security · Computer Science 2025-04-15 Kang Yang , Guanhong Tao , Xun Chen , Jun Xu

In recent years, the growing interest in Large Language Models (LLMs) has significantly advanced prompt engineering, transitioning from manual design to model-based optimization. Prompts for LLMs generally comprise two components: the…

Computation and Language · Computer Science 2025-10-09 Qinhao Zhou , Xiang Xiang , Kun He , John E. Hopcroft

The pursuit of diverse, complex, and large-scale instruction data is crucial for automatically aligning large language models (LLMs). While there are methods capable of generating synthetic instructions at scale, they either suffer from…

Computation and Language · Computer Science 2025-06-05 Chiwei Zhu , Benfeng Xu , Xiaorui Wang , Zhendong Mao

Instruction fine-tuning is crucial for today's large language models (LLMs) to learn to follow instructions and align with human preferences. Conventionally, supervised data, including the instruction and the correct response, is required…

Computation and Language · Computer Science 2024-09-04 Juncheng Xie , Shensian Syu , Hung-yi Lee

Large language models (LLMs) with extended context windows enable tasks requiring extensive information integration but are limited by the scarcity of high-quality, diverse datasets for long-context instruction tuning. Existing data…

Computation and Language · Computer Science 2025-02-25 Jiaxi Li , Xingxing Zhang , Xun Wang , Xiaolong Huang , Li Dong , Liang Wang , Si-Qing Chen , Wei Lu , Furu Wei

Pre-trained large language models (LLMs) can be tailored to adhere to human instructions through instruction tuning. However, due to shifts in the distribution of test-time data, they may not always execute instructions accurately,…

Computation and Language · Computer Science 2024-09-04 Hai Ye , Hwee Tou Ng

Neural Machine Translation has achieved state-of-the-art performance for several language pairs using a combination of parallel and synthetic data. Synthetic data is often generated by back-translating sentences randomly sampled from…

Computation and Language · Computer Science 2018-09-24 Marzieh Fadaee , Christof Monz

Distilling large language models (LLMs) typically involves transferring the teacher model's responses through supervised fine-tuning (SFT). However, this approach neglects the potential to distill both data (output content) and reward…

Computation and Language · Computer Science 2025-02-28 Yudi Zhang , Lu Wang , Meng Fang , Yali Du , Chenghua Huang , Jun Wang , Qingwei Lin , Mykola Pechenizkiy , Dongmei Zhang , Saravan Rajmohan , Qi Zhang

It is challenging to generate high-quality instruction datasets for non-English languages due to tail phenomena, which limit performance on less frequently observed data. To mitigate this issue, we propose translating existing high-quality…

Computation and Language · Computer Science 2024-10-03 Yungi Kim , Chanjun Park

High-quality instruction data is critical for aligning large language models (LLMs). Although some models, such as Llama-3-Instruct, have open weights, their alignment data remain private, which hinders the democratization of AI. High human…

Computation and Language · Computer Science 2024-10-08 Zhangchen Xu , Fengqing Jiang , Luyao Niu , Yuntian Deng , Radha Poovendran , Yejin Choi , Bill Yuchen Lin

Modern large language models (LLMs) such as GPT, Claude, and Gemini have transformed the way we learn, work, and communicate. Yet, their ability to produce highly human-like text raises serious concerns about misinformation and academic…

Computation and Language · Computer Science 2026-03-03 Hongyi Zhou , Jin Zhu , Kai Ye , Ying Yang , Erhan Xu , Chengchun Shi

Developing effective instruction-following policies in reinforcement learning remains challenging due to the reliance on extensive human-labeled instruction datasets and the difficulty of learning from sparse rewards. In this paper, we…

Machine Learning · Computer Science 2025-06-26 Zhicheng Zhang , Ziyan Wang , Yali Du , Fei Fang