English
Related papers

Related papers: MDIT: A Model-free Data Interpolation Method for D…

200 papers

Pre-trained vision-language models (VLMs), such as CLIP, have demonstrated impressive capability in visual tasks, but their fine-tuning often suffers from bias in class-imbalanced scene. Recent works have introduced large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Yongju Jia , Jiarui Ma , Xiangxian Li , Baiqiao Zhang , Xianhui Cao , Juan Liu , Yulong Bian

Large language models (LLMs) show remarkable abilities with instruction tuning. However, they fail to achieve ideal tasks when lacking high-quality instruction tuning data on target tasks. Multi-Aspect Controllable Text Generation (MCTG) is…

Computation and Language · Computer Science 2024-10-21 Chenyang Zhang , Jiayi Lin , Haibo Tong , Bingxuan Hou , Dongyu Zhang , Jialin Li , Junli Wang

Recent advances in large language models (LLMs) have demonstrated the effectiveness of Iterative Self-Improvement (ISI) techniques. However, continuous training on self-generated data leads to reduced output diversity, a limitation…

Computation and Language · Computer Science 2025-01-03 Yiwei Qin , Yixiu Liu , Pengfei Liu

While large language models (LLMs) have exhibited impressive instruction-following capabilities, it is still unclear whether and to what extent they can respond to explicit constraints that might be entailed in various instructions. As a…

Computation and Language · Computer Science 2024-01-02 Yihan Chen , Benfeng Xu , Quan Wang , Yi Liu , Zhendong Mao

Retrieval-augmented language models (RALMs) improve performance by accessing long-tail and up-to-date knowledge from external data stores, but are challenging to build. Existing approaches require either expensive retrieval-specific…

While large language models (LLMs) often adopt finetuning to unlock their capabilities for downstream applications, our understanding on the inductive biases (especially the scaling properties) of different finetuning methods is still…

Computation and Language · Computer Science 2024-02-28 Biao Zhang , Zhongtao Liu , Colin Cherry , Orhan Firat

As large language models rapidly evolve to support longer context, there is a notable disparity in their capability to generate output at greater lengths. Recent study suggests that the primary cause for this imbalance may arise from the…

Computation and Language · Computer Science 2024-10-16 Yingda Chen , Xingjun Wang , Jintao Huang , Yunlin Mao , Daoze Zhang , Yuze Zhao

While recent advances in preference learning have enhanced alignment in human feedback, mathematical reasoning remains a persistent challenge. We investigate how data diversification strategies in preference optimization can improve the…

Artificial Intelligence · Computer Science 2025-07-04 Berkan Dokmeci , Qingyang Wu , Ben Athiwaratkun , Ce Zhang , Shuaiwen Leon Song , James Zou

We present a synthetic data approach for instruction-tuning large language models (LLMs) for low-resource languages in a data-efficient manner, specifically focusing on Thai. We identify three key properties that contribute to the…

Computation and Language · Computer Science 2024-11-26 Parinthapat Pengpun , Can Udomcharoenchaikit , Weerayut Buaphet , Peerat Limkonchotiwat

Instruction tuning is a burgeoning method to elicit the general intelligence of Large Language Models (LLMs). While numerous studies have examined the impact of factors such as data volume and model size on English models, the scaling…

Computation and Language · Computer Science 2025-03-04 Chiyu Song , Zhanchao Zhou , Jianhao Yan , Yuejiao Fei , Zhenzhong Lan , Yue Zhang

Machine learning (ML) models have significantly impacted various domains in our everyday lives. While large language models (LLMs) offer intuitive interfaces and versatility, task-specific ML models remain valuable for their efficiency and…

Human-Computer Interaction · Computer Science 2024-12-04 Wataru Kawabe , Yusuke Sugano

Large language models (LLMs) rely on pretraining on massive and heterogeneous corpora, where training data composition has a decisive impact on training efficiency and downstream generalization under realistic compute and data budget…

Computation and Language · Computer Science 2026-04-21 Zhuo Chen , Yuxuan Miao , Supryadi , Deyi Xiong

Instruction-following has emerged as a crucial capability for large language models (LLMs). However, existing approaches often rely on pre-existing documents or external resources to synthesize instruction-following data, which limits their…

Computation and Language · Computer Science 2025-06-12 Tingfeng Hui , Pengyu Zhu , Bowen Ping , Ling Tang , Guanting Dong , Yaqi Zhang , Sen Su

Multi-modal Large Language Models (MLLMs) are increasingly prominent in the field of artificial intelligence. Visual instruction fine-tuning (IFT) is a vital process for aligning MLLMs' output with user's intentions. High-quality and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xiaotian Han , Yiqi Wang , Bohan Zhai , Quanzeng You , Hongxia Yang

Recent work shows that post-training datasets for LLMs can be substantially downsampled without noticeably deteriorating performance. However, data selection often incurs high computational costs or is limited to narrow domains. In this…

Computation and Language · Computer Science 2025-09-25 Paramita Mirza , Lucas Weber , Fabian Küch

In recent years, the use of large language models (LLMs) for text classification has attracted widespread attention. Despite this, the classification accuracy of LLMs has not yet universally surpassed that of smaller models. LLMs can…

Computation and Language · Computer Science 2024-12-11 Min Zeng , Caiquan Liu , Shiqi Zhang , Li Xie , Chen Sang , Xiaoxin Chen

Large Language models (LLMs), while powerful, exhibit harmful social biases. Debiasing is often challenging due to computational costs, data constraints, and potential degradation of multi-task language capabilities. This work introduces a…

Computation and Language · Computer Science 2024-09-17 Pengrui Han , Rafal Kocielnik , Adhithya Saravanan , Roy Jiang , Or Sharir , Anima Anandkumar

Instruction tuning aims to align large language models (LLMs) with open-domain instructions and human-preferred responses. While several studies have explored autonomous approaches to distilling and annotating instructions from powerful…

Computation and Language · Computer Science 2024-10-04 Yuanhao Yue , Chengyu Wang , Jun Huang , Peng Wang

As instruction-tuned large language models (LLMs) gain global adoption, their ability to follow instructions in multiple languages becomes increasingly crucial. In this work, we investigate how multilinguality during instruction tuning of a…

Computation and Language · Computer Science 2024-05-22 Uri Shaham , Jonathan Herzig , Roee Aharoni , Idan Szpektor , Reut Tsarfaty , Matan Eyal

Instruction tuning -- tuning large language models on instruction-output pairs -- is a promising technique for making models better adapted to the real world. Yet, the key factors driving the model's capability to understand and follow…

Computation and Language · Computer Science 2024-06-03 Dylan Zhang , Justin Wang , Francois Charton