English
Related papers

Related papers: Disagreement-Regularized Importance Sampling for A…

200 papers

Off-policy policy estimators that use importance sampling (IS) can suffer from high variance in long-horizon domains, and there has been particular excitement over new IS methods that leverage the structure of Markov decision processes. We…

Machine Learning · Computer Science 2020-06-09 Yao Liu , Pierre-Luc Bacon , Emma Brunskill

The deep model training procedure requires large-scale datasets of annotated data. Due to the difficulty of annotating a large number of samples, label noise caused by incorrect annotations is inevitable, resulting in low model performance…

Machine Learning · Computer Science 2023-12-12 Fengpeng Li , Kemou Li , Jinyu Tian , Jiantao Zhou

In a binary classification problem where the goal is to fit an accurate predictor, the presence of corrupted labels in the training data set may create an additional challenge. However, in settings where likelihood maximization is poorly…

Statistics Theory · Mathematics 2021-06-18 Yonghoon Lee , Rina Foygel Barber

In this paper, we study a classification problem in which sample labels are randomly corrupted. In this scenario, there is an unobservable sample with noise-free labels. However, before being observed, the true labels are independently…

Machine Learning · Statistics 2015-07-21 Tongliang Liu , Dacheng Tao

We study binary classification in the setting where the learner is presented with multiple corrupted training samples, with possibly different sample sizes and degrees of corruption, and introduce an approach based on minimizing a weighted…

Machine Learning · Statistics 2019-10-11 Clayton Scott , Jianxin Zhang

We derive an (almost) guaranteed upper bound on the error of deep neural networks under distribution shift using unlabeled test data. Prior methods either give bounds that are vacuous in practice or give estimates that are accurate on…

Machine Learning · Statistics 2023-06-02 Elan Rosenfeld , Saurabh Garg

Learning to sample from complex unnormalized distributions over discrete domains emerged as a promising research direction with applications in statistical physics, variational inference, and combinatorial optimization. Recent work has…

Marginalized importance sampling (MIS), which measures the density ratio between the state-action occupancy of a target policy and that of a sampling distribution, is a promising approach for off-policy evaluation. However, current…

Machine Learning · Computer Science 2023-11-15 Scott Fujimoto , David Meger , Doina Precup

Score-based diffusion models (SBDMs) are powerful amortized samplers for Boltzmann distributions; however, imperfect score estimates bias downstream Monte Carlo estimates. Classical importance sampling (IS) can correct this bias, but…

Machine Learning · Computer Science 2025-11-10 Fengzhe Zhang , Laurence I. Midgley , José Miguel Hernández-Lobato

Mislabeled samples are ubiquitous in real-world datasets as rule-based or expert labeling is usually based on incorrect assumptions or subject to biased opinions. Neural networks can "memorize" these mislabeled samples and, as a result,…

Machine Learning · Computer Science 2021-11-24 Katharina Rombach , Gabriel Michau , Olga Fink

Importance sampling approximates expectations with respect to a target measure by using samples from a proposal measure. The performance of the method over large classes of test functions depends heavily on the closeness between both…

Computation · Statistics 2016-09-01 Daniel Sanz-Alonso

In computational social science (CSS), researchers analyze documents to explain social and political phenomena. In most scenarios, CSS researchers first obtain labels for documents and then explain labels using interpretable regression…

Methodology · Statistics 2024-01-17 Naoki Egami , Musashi Hinck , Brandon M. Stewart , Hanying Wei

Deep models trained with noisy labels are prone to over-fitting and struggle in generalization. Most existing solutions are based on an ideal assumption that the label noise is class-conditional, i.e., instances of the same class share the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Ganlong Zhao , Guanbin Li , Yipeng Qin , Feng Liu , Yizhou Yu

Overfitting commonly occurs when applying deep neural networks (DNNs) on small-scale datasets, where DNNs do not generalize well from existing data to unseen data. The main reason resulting in overfitting is that small-scale datasets cannot…

Machine Learning · Computer Science 2024-08-12 Yangdi Wang , Zhi-Hai Zhang , Su Xiu Xu , Wenming Guo

Different from the traditional supervised learning in which each training example has only one explicit label, superset label learning (SLL) refers to the problem that a training example can be associated with a set of candidate labels, and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Chen Gong , Tongliang Liu , Yuanyan Tang , Jian Yang , Jie Yang , Dacheng Tao

Clustered sampling is prevalent in empirical regression discontinuity (RD) designs, but it has not received much attention in the theoretical literature. In this paper, we introduce a general model-based framework for such settings and…

Econometrics · Economics 2026-03-20 Claudia Noack , Tomasz Olma , Christoph Rothe

Flow matching models effectively represent complex distributions, yet estimating expectations of functions of their outputs remains challenging under limited sampling budgets. Independent sampling often yields high-variance estimates,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xinshuang Liu , Runfa Blark Li , Shaoxiu Wei , Truong Nguyen

We discuss the development of reliability acceptance sampling plans under progressive Type-I interval censoring schemes in the presence of competing causes of failure. We consider a general framework to accommodate the presence of…

Applications · Statistics 2025-01-22 Rathin Das , Soumya Roy , Biswabrata Pradhan

In importance sampling (IS)-based reinforcement learning algorithms such as Proximal Policy Optimization (PPO), IS weights are typically clipped to avoid large variance in learning. However, policy update from clipped statistics induces…

Machine Learning · Computer Science 2019-05-30 Seungyul Han , Youngchul Sung

Reliability updating refers to a problem that integrates Bayesian updating technique with structural reliability analysis and cannot be directly solved by structural reliability methods (SRMs) when it involves equality information. The…

Machine Learning · Computer Science 2023-04-19 Xiong Xiao , Zeyu Wang , Quanwang Li