English
Related papers

Related papers: Leveraging Importance Weights in Subset Selection

200 papers

In clinical settings, we often face the challenge of building prediction models based on small observational data sets. For example, such a data set might be from a medical center in a multi-center study. Differences between centers might…

Ensembles over neural network weights trained from different random initialization, known as deep ensembles, achieve state-of-the-art accuracy and calibration. The recently introduced batch ensembles provide a drop-in replacement that is…

Machine Learning · Computer Science 2021-01-11 Florian Wenzel , Jasper Snoek , Dustin Tran , Rodolphe Jenatton

Multiple importance sampling (MIS) is an increasingly used methodology where several proposal densities are used to approximate integrals, generally involving target probability density functions. The use of several proposals allows for a…

Statistics Theory · Mathematics 2022-07-12 Rahul Mukerjee , Víctor Elvira

Mislabeled, duplicated, or biased data in real-world scenarios can lead to prolonged training and even hinder model convergence. Traditional solutions prioritizing easy or hard samples lack the flexibility to handle such a variety…

Machine Learning · Computer Science 2023-11-08 Zhijie Deng , Peng Cui , Jun Zhu

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when…

Methodology · Statistics 2020-09-18 Paul A. Parker , Scott H. Holan

Feature importance aims at measuring how crucial each input feature is for model prediction. It is widely used in feature engineering, model selection and explainable artificial intelligence (XAI). In this paper, we propose a new tree-model…

Machine Learning · Statistics 2020-09-17 Fan Fang , Carmine Ventre , Lingbo Li , Leslie Kanthan , Fan Wu , Michail Basios

We study the problem of reducing the amount of labeled training data required to train supervised classification models. We approach it by leveraging Active Learning, through sequential selection of examples which benefit the model most.…

Machine Learning · Computer Science 2019-01-18 Fedor Zhdanov

In this paper, I proof that Importance Sampling estimates based on dependent sample sets are consistent under certain conditions. This can be used to reduce variance in Bayesian Models with factorizing likelihoods, using sample sets that…

Methodology · Statistics 2015-03-03 Ingmar Schuster

Model pruning is an essential procedure for building compact and computationally-efficient machine learning models. A key feature of a good pruning algorithm is that it accurately quantifies the relative importance of the model weights.…

Machine Learning · Computer Science 2020-06-22 Mingchen Li , Yahya Sattar , Christos Thrampoulidis , Samet Oymak

Most state-of-the-art computer vision models heavily depend on data. However, many datasets exhibit extreme class imbalance which has been shown to negatively impact model performance. Among the training-time and data-generation solutions…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Indu Panigrahi , Richard Zhu

The aim of Active Learning is to select the most informative samples from an unlabelled set of data. This is useful in cases where the amount of data is large and labelling is expensive, such as in machine vision or medical imaging. Two…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Julien Combes , Alexandre Derville , Jean-François Coeurjolly

Modern computer vision algorithms often rely on very large training datasets. However, it is conceivable that a carefully selected subsample of the dataset is sufficient for training. In this paper, we propose a gradient-based importance…

Machine Learning · Computer Science 2018-12-03 Kailas Vodrahalli , Ke Li , Jitendra Malik

Deep neural networks have been shown to easily overfit to biased training data with label noise or class imbalance. Meta-learning algorithms are commonly designed to alleviate this issue in the form of sample reweighting, by learning a meta…

Machine Learning · Computer Science 2020-12-11 Hongxin Wei , Lei Feng , Rundong Wang , Bo An

The era of huge data necessitates highly efficient machine learning algorithms. Many common machine learning algorithms, however, rely on computationally intensive subroutines that are prohibitively expensive on large datasets. Oftentimes,…

Machine Learning · Computer Science 2023-09-26 Mo Tiwari

Many machine learning algorithms are based on the assumption that training examples are drawn independently. However, this assumption does not hold anymore when learning from a networked sample where two or more training examples may share…

Machine Learning · Computer Science 2017-02-21 Yuyi Wang , Jan Ramon , Zheng-Chu Guo

Example weighting algorithm is an effective solution to the training bias problem, however, most previous typical methods are usually limited to human knowledge and require laborious tuning of hyperparameters. In this paper, we propose a…

Machine Learning · Computer Science 2019-11-27 Zhenmao Li , Yichao Wu , Ken Chen , Yudong Wu , Shunfeng Zhou , Jiaheng Liu , Junjie Yan

Creating large, good quality labeled data has become one of the major bottlenecks for developing machine learning applications. Multiple techniques have been developed to either decrease the dependence of labeled data (zero/few-shot…

Computation and Language · Computer Science 2023-02-08 Abhinav Bohra , Huy Nguyen , Devashish Khatwani

This paper revisits the well known single machine scheduling problem to minimize total weighted completion times. The twist is that job sizes are stochastic from unknown distributions, and the scheduler has access to only a single sample…

Data Structures and Algorithms · Computer Science 2023-08-23 Puck te Rietmole , Marc Uetz

We propose several ways of reusing subword embeddings and other weights in subword-aware neural language models. The proposed techniques do not benefit a competitive character-aware model, but some of them improve the performance of…

Computation and Language · Computer Science 2018-04-26 Zhenisbek Assylbekov , Rustem Takhanov

This paper considers the problem of algorithm selection for community detection. The aim of community detection is to identify sets of nodes in a network which are more interconnected relative to their connectivity to the rest of the…

Social and Information Networks · Computer Science 2010-10-27 Leto Peel