English
Related papers

Related papers: DoG-Instruct: Towards Premium Instruction-Tuning D…

200 papers

The promise of generative AI to revolutionize education is constrained by the pedagogical limits of large language models (LLMs). A major issue is the lack of access to high-quality training data that reflect the learning of actual…

Computation and Language · Computer Science 2025-10-07 Janos Perczel , Jin Chow , Dorottya Demszky

Post-training is essential for enabling large language models (LLMs) to follow human instructions. However, its effectiveness depends on high-quality instruction data, which is challenging to obtain in the real world due to privacy…

Artificial Intelligence · Computer Science 2025-02-21 Shuo Tang , Xianghe Pang , Zexi Liu , Bohan Tang , Rui Ye , Tian Jin , Xiaowen Dong , Yanfeng Wang , Siheng Chen

Large Language Models (LLMs) have demonstrated impressive capabilities in creative tasks such as storytelling and E-mail generation. However, as LLMs are primarily trained on final text results rather than intermediate revisions, it might…

Computation and Language · Computer Science 2023-12-21 Lei Shu , Liangchen Luo , Jayakumar Hoskere , Yun Zhu , Yinxiao Liu , Simon Tong , Jindong Chen , Lei Meng

With the rapid development of large language models in recent years, there has been an increasing demand for domain-specific Agents that can cater to the unique needs of enterprises and organizations. Unlike general models, which strive for…

Computation and Language · Computer Science 2024-08-13 Chih-Wei Song , Yu-Kai Lee , Yin-Te Tsai

Manually annotating instruction data for large language models is difficult, costly, and hard to scale. Meanwhile, current automatic annotation methods typically rely on distilling synthetic data from proprietary LLMs, which not only limits…

Computation and Language · Computer Science 2024-08-21 Shu Chen , Xinyan Guan , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun

Instruction Tuning (IT), the process of training large language models (LLMs) using instruction-response pairs, has emerged as the predominant method for transforming base pre-trained LLMs into open-domain conversational agents. While IT…

Computation and Language · Computer Science 2024-07-16 Sreyan Ghosh , Chandra Kiran Reddy Evuru , Sonal Kumar , Ramaneswaran S , Deepali Aneja , Zeyu Jin , Ramani Duraiswami , Dinesh Manocha

The use of LLM tutors to provide automated educational feedback to students on student assignment submissions has received much attention in the AI in Education field. However, the stochastic nature and tendency for hallucinations in LLMs…

Computers and Society · Computer Science 2025-08-11 Keyang Qian , Yixin Cheng , Rui Guan , Wei Dai , Flora Jin , Kaixun Yang , Sadia Nawaz , Zachari Swiecki , Guanliang Chen , Lixiang Yan , Dragan Gašević

In order for large language model (LLM)-based assistants to effectively adapt to evolving information needs, it must be possible to update their factual knowledge through continued training on new data. The standard recipe for doing so…

Computation and Language · Computer Science 2024-05-28 Zhengbao Jiang , Zhiqing Sun , Weijia Shi , Pedro Rodriguez , Chunting Zhou , Graham Neubig , Xi Victoria Lin , Wen-tau Yih , Srinivasan Iyer

As research in large language models (LLMs) continues to accelerate, LLM-based evaluation has emerged as a scalable and cost-effective alternative to human evaluations for comparing the ever increasing list of models. This paper…

Computation and Language · Computer Science 2024-04-17 Zhiyuan Zeng , Jiatong Yu , Tianyu Gao , Yu Meng , Tanya Goyal , Danqi Chen

Synthetic data has the potential to improve the performance, training efficiency, and privacy of real training examples. Nevertheless, existing approaches for synthetic text generation are mostly heuristics and cannot generate…

Machine Learning · Computer Science 2025-06-10 Dang Nguyen , Zeman Li , Mohammadhossein Bateni , Vahab Mirrokni , Meisam Razaviyayn , Baharan Mirzasoleiman

Optimizing training performance in large language models (LLMs) remains an essential challenge, particularly in improving model performance while maintaining computational costs. This work challenges the conventional approach of training…

Computation and Language · Computer Science 2025-11-04 Chun-Hao Yang , Bo-Han Feng , Tzu-Yuan Lai , Yan Yu Chen , Yin-Kai Dean Huang , Shou-De Lin

Large Language Models (LLMs) have assisted humans in several writing tasks, including text revision and story generation. However, their effectiveness in supporting domain-specific writing, particularly in business contexts, is relatively…

Human-Computer Interaction · Computer Science 2024-07-17 Minhwa Lee , Zae Myung Kim , Vivek Khetan , Dongyeop Kang

Fine-tuning large language models (LLMs) on multi-task instruction-following data has been proven to be a powerful learning paradigm for improving their zero-shot capabilities on new tasks. Recent works about high-quality…

Computation and Language · Computer Science 2024-06-17 Wei Han , Hui Chen , Soujanya Poria

Large language models (LLMs) are powerful dialogue agents, but specializing them towards fulfilling a specific function can be challenging. Instructing tuning, i.e. tuning models on instruction and sample responses generated by humans…

Computation and Language · Computer Science 2024-01-11 Dennis Ulmer , Elman Mansimov , Kaixiang Lin , Justin Sun , Xibin Gao , Yi Zhang

Large Language Models (LLMs) have revolutionized the field of natural language processing, but they fall short in comprehending biological sequences such as proteins. To address this challenge, we propose InstructProtein, an innovative LLM…

Biomolecules · Quantitative Biology 2023-10-06 Zeyuan Wang , Qiang Zhang , Keyan Ding , Ming Qin , Xiang Zhuang , Xiaotong Li , Huajun Chen

While recent Large Language Models (LLMs) have proven useful in answering user queries, they are prone to hallucination, and their responses often lack credibility due to missing references to reliable sources. An intuitive solution to…

Computation and Language · Computer Science 2024-09-04 Chengyu Huang , Zeqiu Wu , Yushi Hu , Wenya Wang

The creation of instruction data and evaluation benchmarks for serving Large language models often involves enormous human annotation. This issue becomes particularly pronounced when rapidly developing such resources for a non-English…

Computation and Language · Computer Science 2024-03-07 Yikun Sun , Zhen Wan , Nobuhiro Ueda , Sakiko Yahata , Fei Cheng , Chenhui Chu , Sadao Kurohashi

Training large language models (LLMs) to follow instructions has significantly enhanced their ability to tackle unseen tasks. However, despite their strong generalization capabilities, instruction-following LLMs encounter difficulties when…

Computation and Language · Computer Science 2025-05-29 Maja Stahl , Timon Ziegenbein , Joonsuk Park , Henning Wachsmuth

Large language models (LLMs) hold the promise of solving diverse tasks when provided with appropriate natural language prompts. However, prompting often leads models to make predictions with lower accuracy compared to finetuning a model…

Computation and Language · Computer Science 2024-08-13 Chenyang Zhao , Xueying Jia , Vijay Viswanathan , Tongshuang Wu , Graham Neubig

Large Language Models (LLMs) have showcased remarkable capabilities in following human instructions. However, recent studies have raised concerns about the robustness of LLMs when prompted with instructions combining textual adversarial…

Computation and Language · Computer Science 2024-02-27 Yuansen Zhang , Xiao Wang , Zhiheng Xi , Han Xia , Tao Gui , Qi Zhang , Xuanjing Huang