English
Related papers

Related papers: Understanding Difficulty-based Sample Weighting wi…

200 papers

Calibration weighting has been widely used to correct selection biases in non-probability sampling, missing data, and causal inference. The main idea is to calibrate the biased sample to the benchmark by adjusting the subject weights.…

Methodology · Statistics 2023-05-30 Chenyin Gao , Shu Yang , Jae Kwang Kim

How can you sample good negative examples for contrastive learning? We argue that, as with metric learning, contrastive learning of representations benefits from hard negative samples (i.e., points that are difficult to distinguish from an…

Machine Learning · Computer Science 2021-01-26 Joshua Robinson , Ching-Yao Chuang , Suvrit Sra , Stefanie Jegelka

There has long been debates on how we could interpret neural networks and understand the decisions our models make. Specifically, why deep neural networks tend to be error-prone when dealing with samples that output low softmax scores. We…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Simiao Zuo , Jialin Wu

A common problem in health research is that we have a large database with many variables measured on a large number of individuals. We are interested in measuring additional variables on a subsample; these measurements may be newly…

Methodology · Statistics 2022-03-22 Thomas Lumley , Tong Chen

Deep convolutional neural networks have achieved remarkable success in face recognition (FR), partly due to the abundant data availability. However, the current training benchmarks exhibit an imbalanced quality distribution; most images are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sahar Rahimi Malakshan , Mohammad Saeed Ebrahimi Saadabadi , Nima Najafzadeh , Nasser M. Nasrabadi

In the context of supervised learning of a function by a neural network, we claim and empirically verify that the neural network yields better results when the distribution of the data set focuses on regions where the function to learn is…

Machine Learning · Statistics 2022-09-28 Paul Novello , Gaël Poëtte , David Lugato , Pietro Congedo

We introduce a probability distribution, combined with an efficient sampling algorithm, for weights and biases of fully-connected neural networks. In a supervised learning context, no iterative optimization or gradient computations of…

Machine Learning · Computer Science 2023-11-14 Erik Lien Bolager , Iryna Burak , Chinmay Datar , Qing Sun , Felix Dietrich

While various complexity measures for deep neural networks exist, specifying an appropriate measure capable of predicting and explaining generalization in deep networks has proven challenging. We propose Neural Complexity (NC), a…

Machine Learning · Computer Science 2020-10-26 Yoonho Lee , Juho Lee , Sung Ju Hwang , Eunho Yang , Seungjin Choi

As machine learning applications grow increasingly ubiquitous and complex, they face an increasing set of requirements beyond accuracy. The prevalent approach to handle this challenge is to aggregate a weighted combination of requirement…

Machine Learning · Computer Science 2026-01-07 Aneesh Barthakur , Luiz F. O. Chamon

The measure of a machine learning algorithm is the difficulty of the tasks it can perform, and sufficiently difficult tasks are critical drivers of strong machine learning models. However, quantifying the generalization difficulty of…

Machine Learning · Computer Science 2023-06-06 Akhilan Boopathy , Kevin Liu , Jaedong Hwang , Shu Ge , Asaad Mohammedsaleh , Ila Fiete

We present a practical and statistically consistent scheme for actively learning binary classifiers under general loss functions. Our algorithm uses importance weighting to correct sampling bias, and by controlling the variance, we are able…

Machine Learning · Computer Science 2009-05-20 Alina Beygelzimer , Sanjoy Dasgupta , John Langford

The application of machine learning to physics problems is widely found in the scientific literature. Both regression and classification problems are addressed by a large array of techniques that involve learning algorithms. Unfortunately,…

Machine Learning · Computer Science 2022-10-03 Umberto Michelucci , Francesca Venturini

Importance sampling is a central idea underlying off-policy prediction in reinforcement learning. It provides a strategy for re-weighting samples from a distribution to obtain unbiased estimates under another distribution. However,…

Machine Learning · Computer Science 2023-06-28 Kristopher De Asis , Eric Graves , Richard S. Sutton

We study generalization in deep learning by appealing to complexity measures originally developed in approximation and information theory. While these concepts are challenged by the high-dimensional and data-defined nature of deep learning,…

Machine Learning · Statistics 2020-12-17 Abhejit Rajagopal , Vamshi C. Madala , Shivkumar Chandrasekaran , Peder E. Z. Larson

In learning with noisy labels, the sample selection approach is very popular, which regards small-loss data as correctly labeled during training. However, losses are generated on-the-fly based on the model being trained with noisy labels,…

Machine Learning · Computer Science 2021-06-02 Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Jun Yu , Gang Niu , Masashi Sugiyama

The generalization capacity of various machine learning models exhibits different phenomena in the under- and over-parameterized regimes. In this paper, we focus on regression models such as feature regression and kernel regression and…

Machine Learning · Computer Science 2022-03-14 Björn Engquist , Kui Ren , Yunan Yang

Recent deep learning approaches have shown great improvement in audio source separation tasks. However, the vast majority of such work is focused on improving average separation performance, often neglecting to examine or control the…

Sound · Computer Science 2022-02-01 Efthymios Tzinis , Dimitrios Bralios , Paris Smaragdis

Deep neural networks are typically trained by optimizing a loss function with an SGD variant, in conjunction with a decaying learning rate, until convergence. We show that simple averaging of multiple points along the trajectory of SGD,…

Machine Learning · Computer Science 2019-02-26 Pavel Izmailov , Dmitrii Podoprikhin , Timur Garipov , Dmitry Vetrov , Andrew Gordon Wilson

One of the principal scientific challenges in deep learning is explaining generalization, i.e., why the particular way the community now trains networks to achieve small training error also leads to small error on held-out data from the…

Understanding generalization in deep neural networks is an active area of research. A promising avenue of exploration has been that of margin measurements: the shortest distance to the decision boundary for a given sample or that sample's…

Machine Learning · Computer Science 2024-05-29 Coenraad Mouton