English
Related papers

Related papers: Group-Level Data Selection for Efficient Pretraini…

200 papers

We study task selection to enhance sample efficiency in model-agnostic meta-reinforcement learning (MAML-RL). Traditional meta-RL typically assumes that all available tasks are equally important, which can lead to task redundancy when they…

Optimization and Control · Mathematics 2025-04-15 Donglin Zhan , Leonardo F. Toso , James Anderson

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

Artificial Intelligence · Computer Science 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

Large language models (LLMs) are one of the most important killer computer applications. The recent algorithmic advancement proposes a fine-grained group-wise quantization for LLMs, which treats a small set (e.g., 64) of values in a tensor…

Hardware Architecture · Computer Science 2025-02-27 Weiming Hu , Haoyan Zhang , Cong Guo , Yu Feng , Renyang Guan , Zhendong Hua , Zihan Liu , Yue Guan , Minyi Guo , Jingwen Leng

Learning relational tabular data has gained significant attention recently, but most studies focus on single tables, overlooking the potential of cross-table learning. Cross-table learning, especially in scenarios where tables lack shared…

Machine Learning · Computer Science 2025-02-17 Zhaomin Wu , Shida Wang , Ziyang Wang , Bingsheng He

Language model (LM) pre-training is useful in many language processing tasks. But can pre-trained LMs be further leveraged for more general machine learning problems? We propose an approach for using LMs to scaffold learning and…

Multi-task learning (MTL) aims to leverage shared information among tasks to improve learning efficiency and accuracy. However, MTL often struggles to effectively manage positive and negative transfer between tasks, which can hinder…

Machine Learning · Computer Science 2025-05-19 Chenguang Wang , Xuanhao Pan , Tianshu Yu

Language models (LMs) can be directed to perform target tasks by using labeled examples or natural language prompts. But selecting examples or writing prompts for can be challenging--especially in tasks that involve unusual edge cases,…

Computation and Language · Computer Science 2023-10-19 Belinda Z. Li , Alex Tamkin , Noah Goodman , Jacob Andreas

Everyday tasks come with a target, and pretraining models around this target is what turns them into experts. In this paper, we study target-oriented language model (LM) pretraining by introducing Neuron-Activated Graph Ranking (NAG-based…

Computation and Language · Computer Science 2026-04-20 Zijun Wang , Haoqin Tu , Weidong Zhou , Yiyang Zhou , Xiaohuan Zhou , Bingni Zhang , Weiguo Feng , Taifeng Wang , Cihang Xie , Fengze Liu

Large language models (LLMs) have revolutionized lots of fields of research. Although it is well-known that fine-tuning is essential for enhancing the capabilities of LLMs, existing research suggests that there is potential redundancy in…

Artificial Intelligence · Computer Science 2025-02-14 Haoling Li , Xin Zhang , Xiao Liu , Yeyun Gong , Yifan Wang , Qi Chen , Peng Cheng

Large Language Models (LLMs) have demonstrated exceptional performance across various tasks, with pre-training stage serving as the cornerstone of their capabilities. However, the conventional fixed-length data composition strategy for…

Computation and Language · Computer Science 2025-06-30 Qing Yang , Qiyao Peng , Hongtao Liu , Kai Liu , Bing Qin , Ting Liu

Language model pretraining generally targets a broad range of use cases and incorporates data from diverse sources. However, there are instances where we desire a model that excels in specific areas without markedly compromising performance…

Computation and Language · Computer Science 2024-09-24 Ernie Chang , Pin-Jie Lin , Yang Li , Changsheng Zhao , Daeil Kim , Rastislav Rabatin , Zechun Liu , Yangyang Shi , Vikas Chandra

Lexicase selection has been shown to provide advantages over other selection algorithms in several areas of evolutionary computation and machine learning. In its standard form, lexicase selection filters a population or other collection…

Neural and Evolutionary Computing · Computer Science 2024-02-12 Andrew Ni , Li Ding , Lee Spector

Optimizing Large Language Model (LLM) performance requires well-crafted prompts, but manual prompt engineering is labor-intensive and often ineffective. Automated prompt optimization techniques address this challenge but the majority of…

Computation and Language · Computer Science 2025-08-20 Ximing Dong , Shaowei Wang , Dayi Lin , Ahmed E. Hassan

We study collective decision-making in a model of human groups, with network interactions, performing two alternative choice tasks. We focus on the speed-accuracy tradeoff, i.e., the tradeoff between a quick decision and a reliable…

Optimization and Control · Mathematics 2014-02-18 Vaibhav Srivastava , Naomi Ehrich Leonard

While large-scale training data is fundamental for developing capable large language models (LLMs), strategically selecting high-quality data has emerged as a critical approach to enhance training efficiency and reduce computational costs.…

Machine Learning · Computer Science 2025-07-23 Yang Yu , Kai Han , Hang Zhou , Yehui Tang , Kaiqi Huang , Yunhe Wang , Dacheng Tao

The coverage and composition of pretraining data significantly impacts the generalization ability of Large Language Models (LLMs). To reduce the carbon footprint and financial costs of training, some data mixing methods, which applied the…

Machine Learning · Computer Science 2025-06-02 Jing Ma , Chenhao Dang , Mingjie Liao

Benefiting from transformer-based pre-trained language models, neural ranking models have made significant progress. More recently, the advent of multilingual pre-trained language models provides great support for designing neural…

Computation and Language · Computer Science 2023-01-31 Zhiqi Huang , Puxuan Yu , James Allan

Estimating mutual correlations between random variables or data streams is essential for intelligent behavior and decision-making. As a fundamental quantity for measuring statistical relationships, mutual information has been extensively…

Information Theory · Computer Science 2024-02-16 Zhengyang Hu , Song Kang , Qunsong Zeng , Kaibin Huang , Yanchao Yang

Real world datasets contain incorrectly labeled instances that hamper the performance of the model and, in particular, the ability to generalize out of distribution. Also, each example might have different contribution towards learning.…

We design and evaluate a Bayesian optimization framework for resource efficient pre-training of Transformer-based language models (TLMs). TLM pre-training requires high computational resources and introduces many unresolved design choices,…

Computation and Language · Computer Science 2023-05-31 Iñigo Urteaga , Moulay-Zaïdane Draïdia , Tomer Lancewicki , Shahram Khadivi