English
Related papers

Related papers: Instruction-tuned Language Models are Better Knowl…

200 papers

Instruction-tuning enhances the ability of large language models (LLMs) to follow user instructions more accurately, improving usability while reducing harmful outputs. However, this process may increase the model's dependence on user…

Computation and Language · Computer Science 2025-07-25 Kyubeen Han , Junseo Jang , Hongjin Kim , Geunyeong Jeong , Harksoo Kim

When large language models are aligned via supervised fine-tuning, they may encounter new factual information that was not acquired through pre-training. It is often conjectured that this can teach the model the behavior of hallucinating…

Computation and Language · Computer Science 2024-10-02 Zorik Gekhman , Gal Yona , Roee Aharoni , Matan Eyal , Amir Feder , Roi Reichart , Jonathan Herzig

Fine-tuning pre-trained large language models (LLMs) on a diverse array of tasks has become a common approach for building models that can solve various natural language processing (NLP) tasks. However, where and to what extent these models…

Computation and Language · Computer Science 2024-10-29 Zheng Zhao , Yftah Ziser , Shay B. Cohen

Pre-trained Language Model (PLM) has become a representative foundation model in the natural language processing field. Most PLMs are trained with linguistic-agnostic pre-training tasks on the surface form of the text, such as the masked…

Computation and Language · Computer Science 2022-11-11 Yiming Cui , Wanxiang Che , Shijin Wang , Ting Liu

Instruction tuning significantly enhances the performance of large language models (LLMs) across various tasks. However, the procedure to optimizing the mixing of instruction datasets for LLM fine-tuning is still poorly understood. This…

Computation and Language · Computer Science 2024-02-20 Renxi Wang , Haonan Li , Minghao Wu , Yuxia Wang , Xudong Han , Chiyu Zhang , Timothy Baldwin

Recently, Multimodal Large Language Models (MLLMs) that enable Large Language Models (LLMs) to interpret images through visual instruction tuning have achieved significant success. However, existing visual instruction tuning methods only…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Chi Chen , Ruoyu Qin , Fuwen Luo , Xiaoyue Mi , Peng Li , Maosong Sun , Yang Liu

Recent progress in pretraining language models on large textual corpora led to a surge of improvements for downstream NLP tasks. Whilst learning linguistic knowledge, these models may also be storing relational knowledge present in the…

Computation and Language · Computer Science 2019-09-05 Fabio Petroni , Tim Rocktäschel , Patrick Lewis , Anton Bakhtin , Yuxiang Wu , Alexander H. Miller , Sebastian Riedel

Despite the recent observation that large language models (LLMs) can store substantial factual knowledge, there is a limited understanding of the mechanisms of how they acquire factual knowledge through pretraining. This work addresses this…

Computation and Language · Computer Science 2024-11-13 Hoyeon Chang , Jinho Park , Seonghyeon Ye , Sohee Yang , Youngkyung Seo , Du-Seong Chang , Minjoon Seo

Emerging multimodal large language models (MLLMs) exhibit great potential for chart question answering (CQA). Recent efforts primarily focus on scaling up training datasets (i.e., charts, data tables, and question-answer (QA) pairs) through…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xingchen Zeng , Haichuan Lin , Yilin Ye , Wei Zeng

The Internet contains a wealth of knowledge -- from the birthdays of historical figures to tutorials on how to code -- all of which may be learned by language models. However, while certain pieces of information are ubiquitous on the web,…

Computation and Language · Computer Science 2023-07-28 Nikhil Kandpal , Haikang Deng , Adam Roberts , Eric Wallace , Colin Raffel

As Large language models (LLMs) are increasingly deployed in diverse applications, faithfully integrating evolving factual knowledge into these models remains a critical challenge. Continued pre-training on paraphrased data has shown…

Computation and Language · Computer Science 2025-06-24 Mingkang Zhu , Xi Chen , Zhongdao Wang , Bei Yu , Hengshuang Zhao , Jiaya Jia

Instruction Fine-tuning~(IFT) is a critical phase in building large language models~(LLMs). Previous works mainly focus on the IFT's role in the transfer of behavioral norms and the learning of additional world knowledge. However, the…

Computation and Language · Computer Science 2024-08-13 Mengjie Ren , Boxi Cao , Hongyu Lin , Cao Liu , Xianpei Han , Ke Zeng , Guanglu Wan , Xunliang Cai , Le Sun

Knowledge enhanced pre-trained language models (K-PLMs) are shown to be effective for many public tasks in the literature but few of them have been successfully applied in practice. To address this problem, we propose K-AID, a systematic…

Artificial Intelligence · Computer Science 2021-09-23 Fu Sun , Feng-Lin Li , Ruize Wang , Qianglong Chen , Xingyi Cheng , Ji Zhang

Large language models require updates to remain up-to-date or adapt to new domains by fine-tuning them with new documents. One key is memorizing the latest information in a way that the memorized information is extractable with a query…

Computation and Language · Computer Science 2025-04-21 Kuniaki Saito , Kihyuk Sohn , Chen-Yu Lee , Yoshitaka Ushiku

This paper proposes LayoutLLM, a more flexible document analysis method for understanding imaged documents. Visually Rich Document Understanding tasks, such as document image classification and information extraction, have gained…

Computation and Language · Computer Science 2024-03-22 Masato Fujitake

Pretrained language models (PTLMs) are typically learned over a large, static corpus and further fine-tuned for various downstream tasks. However, when deployed in the real world, a PTLM-based model must deal with data distributions that…

Computation and Language · Computer Science 2022-07-20 Xisen Jin , Dejiao Zhang , Henghui Zhu , Wei Xiao , Shang-Wen Li , Xiaokai Wei , Andrew Arnold , Xiang Ren

Instruction tuning for large language models (LLMs) can drive them to produce results consistent with human goals in specific downstream tasks. However, the process of continual instruction tuning (CIT) for LLMs may bring about the…

Computation and Language · Computer Science 2025-05-28 Yongquan He , Wenyuan Zhang , Xuancheng Huang , Peng Zhang , Lingxun Meng , Xiang Zhou , Ke Zeng , Xunliang Cai

Knowledge-enhanced Pre-trained Language Model (PLM) has recently received significant attention, which aims to incorporate factual knowledge into PLMs. However, most existing methods modify the internal structures of fixed types of PLMs by…

Computation and Language · Computer Science 2022-10-18 Jianing Wang , Wenkang Huang , Qiuhui Shi , Hongbin Wang , Minghui Qiu , Xiang Li , Ming Gao

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

Computation and Language · Computer Science 2025-10-27 Fufang Wen , Shichang Zhang

The knowledge tracing (KT) problem is an extremely important topic in personalized education, which aims to predict whether students can correctly answer the next question based on their past question-answer records. Prior work on this task…

Computation and Language · Computer Science 2025-02-06 Ziwei Wang , Jie Zhou , Qin Chen , Min Zhang , Bo Jiang , Aimin Zhou , Qinchun Bai , Liang He