English
Related papers

Related papers: Data Selection for ERMs

200 papers

A central question for active learning (AL) is: "what is the optimal selection?" Defining optimality by classifier loss produces a new characterisation of optimal AL behaviour, by treating expected loss reduction as a statistical target for…

Machine Learning · Statistics 2015-02-06 Lewis P. G. Evans , Niall M. Adams , Christoforos Anagnostopoulos

Large recommendation models (LRMs) are fundamental to the multi-billion dollar online advertising industry, processing massive datasets of hundreds of billions of examples before transitioning to continuous online training to adapt to…

Information Retrieval · Computer Science 2024-10-28 Kshitij Jain , Jingru Xie , Kevin Regan , Cheng Chen , Jie Han , Steve Li , Zhuoshu Li , Todd Phillips , Myles Sussman , Matt Troup , Angel Yu , Jia Zhuo

Data curriculums have become central to successful LLM training, yet principles governing optimal data placement remain unclear. We introduce the *training re-evaluation curve (TREC)*, a diagnostic that retrospectively evaluates training…

Machine Learning · Computer Science 2026-02-19 Shane Bergsma , Nolan Dey , Joel Hestness

The efficacy of machine learning (ML) models depends on both algorithms and data. Training data defines what we want our models to learn, and testing data provides the means by which their empirical progress is measured. Benchmark datasets…

Machine Learning · Computer Science 2021-11-23 Lora Aroyo , Matthew Lease , Praveen Paritosh , Mike Schaekermann

Modern ASR systems are typically trained on large-scale pseudo-labeled, in-the-wild data spanning multiple domains. While such heterogeneous data benefit generalist models designed for broad deployment, they pose challenges for specialist…

Extreme learning machine (ELM) is an extremely fast learning method and has a powerful performance for pattern recognition tasks proven by enormous researches and engineers. However, its good generalization ability is built on large numbers…

Machine Learning · Computer Science 2015-02-05 Wentao Zhu , Jun Miao , Laiyun Qing

We study problem-dependent rates, i.e., generalization errors that scale near-optimally with the variance, the effective loss, or the gradient norms evaluated at the "best hypothesis." We introduce a principled framework dubbed "uniform…

Machine Learning · Statistics 2020-12-25 Yunbei Xu , Assaf Zeevi

The empirical risk minimization approach to data-driven decision making requires access to training data drawn under the same conditions as those that will be faced when the decision rule is deployed. However, in a number of settings, we…

Methodology · Statistics 2025-09-17 Roshni Sahoo , Lihua Lei , Stefan Wager

Instruction tuning plays a critical role in aligning large language models (LLMs) with human preference. Despite the vast amount of open instruction datasets, naively training a LLM on all existing instructions may not be optimal and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yulei Qin , Yuncheng Yang , Pengcheng Guo , Gang Li , Hang Shao , Yuchen Shi , Zihan Xu , Yun Gu , Ke Li , Xing Sun

Machine learning (ML) solutions are prevalent in many applications. However, many challenges exist in making these solutions business-grade. For instance, maintaining the error rate of the underlying ML models at an acceptably low level.…

Machine Learning · Computer Science 2023-05-16 Samuel Ackerman , Axel Bendavid , Eitan Farchi , Orna Raz

The task of learning to pick a single preferred example out a finite set of examples, an "optimal choice problem", is a supervised machine learning problem with complex, structured input. Problems of optimal choice emerge often in various…

Artificial Intelligence · Computer Science 2017-07-07 Marina Sapir

A central issue of many statistical learning problems is to select an appropriate model from a set of candidate models. Large models tend to inflate the variance (or overfitting), while small models tend to cause biases (or underfitting)…

Statistics Theory · Mathematics 2020-12-25 Jie Ding , Enmao Diao , Jiawei Zhou , Vahid Tarokh

For many interesting tasks, such as medical diagnosis and web page classification, a learner only has access to some positively labeled examples and many unlabeled examples. Learning from this type of data requires making assumptions about…

Machine Learning · Computer Science 2018-08-28 Jessa Bekker , Jesse Davis

It is generally accepted that starting neural networks training with large learning rates (LRs) improves generalization. Following a line of research devoted to understanding this effect, we conduct an empirical study in a controlled…

Machine Learning · Computer Science 2024-10-30 Ildus Sadrtdinov , Maxim Kodryan , Eduard Pokonechny , Ekaterina Lobacheva , Dmitry Vetrov

Learning how to learn efficiently is a fundamental challenge for biological agents and a growing concern for artificial ones. To learn effectively, an agent must regulate its learning speed, balancing the benefits of rapid improvement…

Machine Learning · Computer Science 2026-01-13 Valentina Njaradi , Rodrigo Carrasco-Davis , Peter E. Latham , Andrew Saxe

Classical learning assumes the learner is given a labeled data sample, from which it learns a model. The field of Active Learning deals with the situation where the learner begins not with a training sample, but instead with resources that…

Machine Learning · Computer Science 2012-07-19 Omid Madani , Daniel J. Lizotte , Russell Greiner

In the last decade, motivated by the success of Deep Learning, the scientific community proposed several approaches to make the learning procedure of Neural Networks more effective. When focussing on the way in which the training data are…

Machine Learning · Computer Science 2021-06-22 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci

In this paper we are concerned with the learnability of energies from data obtained by observing time evolutions of their critical points starting at random initial equilibria. As a byproduct of our theoretical framework we introduce the…

Machine Learning · Computer Science 2019-11-04 Stefano Almi , Massimo Fornasier , Richard Huber

Policy learning can be used to extract individualized treatment regimes from observational data in healthcare, civics, e-commerce, and beyond. One big hurdle to policy learning is a commonplace lack of overlap in the data for different…

Machine Learning · Statistics 2020-12-04 Nathan Kallus

Recently, the robotics community has amassed ever larger and more diverse datasets to train generalist robot policies. However, while these policies achieve strong mean performance across a variety of tasks, they often underperform on…

‹ Prev 1 3 4 5 6 7 10 Next ›