English
Related papers

Related papers: Instruction Tuning with GPT-4

200 papers

Instruction tuning large language models (LLMs) using machine-generated instruction-following data has improved zero-shot capabilities on new tasks, but the idea is less explored in the multimodal field. In this paper, we present the first…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Haotian Liu , Chunyuan Li , Qingyang Wu , Yong Jae Lee

Instruction fine-tuning is crucial for today's large language models (LLMs) to learn to follow instructions and align with human preferences. Conventionally, supervised data, including the instruction and the correct response, is required…

Computation and Language · Computer Science 2024-09-04 Juncheng Xie , Shensian Syu , Hung-yi Lee

This paper aims to efficiently enable Large Language Models (LLMs) to use multimodal tools. Advanced proprietary LLMs, such as ChatGPT and GPT-4, have shown great potential for tool usage through sophisticated prompt engineering.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Rui Yang , Lin Song , Yanwei Li , Sijie Zhao , Yixiao Ge , Xiu Li , Ying Shan

In this work, we evaluate 10 open-source instructed LLMs on four representative code comprehension and generation tasks. We have the following main findings. First, for the zero-shot setting, instructed LLMs are very competitive on code…

Computation and Language · Computer Science 2023-08-03 Zhiqiang Yuan , Junwei Liu , Qiancheng Zi , Mingwei Liu , Xin Peng , Yiling Lou

Instruction tuning is crucial for enabling Large Language Models (LLMs) to solve real-world tasks. Prior work has shown the effectiveness of instruction-tuning data synthesized solely from LLMs, raising a fundamental question: Do we still…

The creation of instruction data and evaluation benchmarks for serving Large language models often involves enormous human annotation. This issue becomes particularly pronounced when rapidly developing such resources for a non-English…

Computation and Language · Computer Science 2024-03-07 Yikun Sun , Zhen Wan , Nobuhiro Ueda , Sakiko Yahata , Fei Cheng , Chenhui Chu , Sadao Kurohashi

This paper explores a simple method for improving the zero-shot learning abilities of language models. We show that instruction tuning -- finetuning language models on a collection of tasks described via instructions -- substantially…

Computation and Language · Computer Science 2022-02-10 Jason Wei , Maarten Bosma , Vincent Y. Zhao , Kelvin Guu , Adams Wei Yu , Brian Lester , Nan Du , Andrew M. Dai , Quoc V. Le

As large language models (LLMs) continue to advance, instruction tuning has become critical for improving their ability to generate accurate and contextually appropriate responses. Although numerous instruction-tuning datasets have been…

Computation and Language · Computer Science 2024-10-18 Jielin Song , Siyu Liu , Bin Zhu , Yanghui Rao

In this work, we introduce instruction finetuning for Neural Machine Translation (NMT) models, which distills instruction following capabilities from Large Language Models (LLMs) into orders-of-magnitude smaller NMT models. Our…

Computation and Language · Computer Science 2024-10-10 Vikas Raunak , Roman Grundkiewicz , Marcin Junczys-Dowmunt

Large pre-trained language models (LMs) such as GPT-3 have acquired a surprising ability to perform zero-shot learning. For example, to classify sentiment without any training examples, we can "prompt" the LM with the review and the label…

Computation and Language · Computer Science 2021-09-09 Ruiqi Zhong , Kristy Lee , Zheng Zhang , Dan Klein

Multi-modal large language models have demonstrated impressive performances on most vision-language tasks. However, the model generally lacks the understanding capabilities for specific domain data, particularly when it comes to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yucheng Han , Chi Zhang , Xin Chen , Xu Yang , Zhibin Wang , Gang Yu , Bin Fu , Hanwang Zhang

Context: The rapid evolution of Large Language Models (LLMs) has sparked significant interest in leveraging their capabilities for automating code review processes. Prior studies often focus on developing LLMs for code review automation,…

Software Engineering · Computer Science 2024-06-18 Chanathip Pornprasit , Chakkrit Tantithamthavorn

Multimodal large language models are typically trained in two stages: first pre-training on image-text pairs, and then fine-tuning using supervised vision-language instruction data. Recent studies have shown that large language models can…

Machine Learning · Computer Science 2026-04-14 Lai Wei , Xiaozhe Li , Zihao Jiang , Weiran Huang , Lichao Sun

Large language models (LLMs), such as GPT-4, PaLM, and LLaMa, have been shown to achieve remarkable performance across a variety of natural language tasks. Recent advancements in instruction tuning bring LLMs with ability in following…

Computation and Language · Computer Science 2023-09-12 Vu-Thuan Doan , Quoc-Truong Truong , Duc-Vu Nguyen , Vinh-Tiep Nguyen , Thuy-Ngan Nguyen Luu

The purpose of instruction tuning is enabling zero-shot performance, but instruction tuning has also been shown to improve chain-of-thought reasoning and value alignment (Si et al., 2023). Here we consider the impact on…

Computation and Language · Computer Science 2024-10-04 Constanza Fierro , Jiaang Li , Anders Søgaard

Tabular instruction tuning has emerged as a promising research direction for improving LLMs understanding of tabular data. However, the majority of existing works only consider question-answering and reasoning tasks over tabular data,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Milad Abdollahzadeh , Abdul Raheem , Zilong Zhao , Uzair Javaid , Kevin Yee , Nalam Venkata Abhishek , Tram Truong-Huu , Biplab Sikdar

Instruction tuning is instrumental in enabling Large Language Models~(LLMs) to follow user instructions to complete various open-domain tasks. The success of instruction tuning depends on the availability of high-quality instruction data.…

Computation and Language · Computer Science 2023-08-25 Yue Wang , Xinrui Wang , Juntao Li , Jinxiong Chang , Qishen Zhang , Zhongyi Liu , Guannan Zhang , Min Zhang

Instruction tuning for large language models (LLMs) has gained attention from researchers due to its ability to unlock the potential of LLMs in following instructions. While instruction tuning offers advantages for facilitating the…

Artificial Intelligence · Computer Science 2023-05-17 Hao Chen , Yiming Zhang , Qi Zhang , Hantao Yang , Xiaomeng Hu , Xuetao Ma , Yifan Yanggong , Junbo Zhao

The rapid advancements in large language models (LLMs) have greatly expanded the potential for automated code-related tasks. Two primary methodologies are used in this domain: prompt engineering and fine-tuning. Prompt engineering involves…

Software Engineering · Computer Science 2025-02-21 Jiho Shin , Clark Tang , Tahmineh Mohati , Maleknaz Nayebi , Song Wang , Hadi Hemmati

Large Language Models (LLMs) for public use require continuous pre-training to remain up-to-date with the latest data. The models also need to be fine-tuned with specific instructions to maintain their ability to follow instructions…

Computation and Language · Computer Science 2024-10-15 Ishan Jindal , Chandana Badrinath , Pranjal Bharti , Lakkidi Vinay , Sachin Dev Sharma
‹ Prev 1 2 3 10 Next ›