English
Related papers

Related papers: An Iteratively Re-weighted Method for Problems wit…

200 papers

Propensity score (PS) weighting methods are often used in non-randomized studies to adjust for confounding and assess treatment effects. The most popular among them, the inverse probability weighting (IPW), assigns weights that are…

Methodology · Statistics 2020-11-04 Yunji Zhou , Roland A. Matsouaka , Laine Thomas

For statistical modeling wherein the data regime is unfavorable in terms of dimensionality relative to the sample size, finding hidden sparsity in the ground truth can be critical in formulating an accurate statistical model. The so-called…

Optimization and Control · Mathematics 2025-08-04 Matteo Bergamaschi , Andrea Cristofari , Vyacheslav Kungurtsev , Francesco Rinaldi

Reconstruction of signals from undersampled and noisy measurements is a topic of considerable interest. Sharpness conditions directly control the recovery performance of restart schemes for first-order methods without the need for…

Numerical Analysis · Mathematics 2021-10-26 Matthew J. Colbrook

A major challenge to out-of-distribution generalization is reliance on spurious features -- patterns that are predictive of the class label in the training data distribution, but not causally related to the target. Standard methods for…

Machine Learning · Computer Science 2023-06-21 Shikai Qiu , Andres Potapczynski , Pavel Izmailov , Andrew Gordon Wilson

We design a new iterative algorithm, called REINFORCE-OPT, for solving a general type of optimization problems. This algorithm parameterizes the solution search rule and iteratively updates the parameter using a reinforcement learning (RL)…

Optimization and Control · Mathematics 2025-01-27 Chen Xu , Yun-Bin Zhao , Zhipeng Lu , Ye Zhang

In this paper, we study the problem of image recovery from given partial (corrupted) observations. Recovering an image using a low-rank model has been an active research area in data analysis and machine learning. But often, images are not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Pawan Goyal , Hussam Al Daas , Peter Benner

Given the ever-increasing size of modern neural networks, the significance of sparse architectures has surged due to their accelerated inference speeds and minimal memory demands. When it comes to global pruning techniques, Iterative…

Machine Learning · Computer Science 2024-04-29 Moonseok Choi , Hyungi Lee , Giung Nam , Juho Lee

Optimizing objective functions subject to constraints is fundamental in many real-world applications. However, these constraints are often not readily defined and must be inferred from expert agent behaviors, a problem known as Inverse…

Machine Learning · Computer Science 2025-05-19 Bo Yue , Jian Li , Guiliang Liu

In this paper, we study the problem of balancing effectiveness and efficiency in automated feature selection. Feature selection is a fundamental intelligence for machine learning and predictive analysis. After exploring many feature…

Machine Learning · Computer Science 2020-09-17 Wei Fan , Kunpeng Liu , Hao Liu , Pengyang Wang , Yong Ge , Yanjie Fu

Continual learning algorithms which keep the parameters of new tasks close to that of previous tasks, are popular in preventing catastrophic forgetting in sequential task learning settings. However, 1) the performance for the new continual…

Machine Learning · Computer Science 2023-07-21 Wei Cong , Yang Cong , Gan Sun , Yuyang Liu , Jiahua Dong

In randomized clinical trials, adjusting for baseline covariates can improve credibility and efficiency for demonstrating and quantifying treatment effects. This article studies the augmented inverse propensity weighted (AIPW) estimator,…

Methodology · Statistics 2024-03-27 Marlena S. Bannick , Jun Shao , Jingyi Liu , Yu Du , Yanyao Yi , Ting Ye

Improving the generalization ability of modern deep neural networks (DNNs) is a fundamental challenge in machine learning. Two branches of methods have been proposed to seek flat minima and improve generalization: one led by sharpness-aware…

Machine Learning · Computer Science 2024-04-02 Tao Li , Qinghua Tao , Weihao Yan , Zehao Lei , Yingwen Wu , Kun Fang , Mingzhen He , Xiaolin Huang

Implicit Neural Representations (INRs) have revolutionized signal processing and computer vision by modeling signals as continuous, differentiable functions parameterized by neural networks. However, INRs are prone to the spectral bias…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ali Haider , Muhammad Salman Ali , Maryam Qamar , Tahir Khalil , Soo Ye Kim , Jihyong Oh , Enzo Tartaglione , Sung-Ho Bae

Dynamic Treatment Regimes (DTRs) provide a systematic framework for optimizing sequential decision-making in chronic disease management, where therapies must adapt to patients' evolving clinical profiles. Inverse probability weighting (IPW)…

Methodology · Statistics 2026-03-26 Chloe Si , David A. Stephens , Erica E. M. Moodie

To recover a sparse signal from an underdetermined system, we often solve a constrained L1-norm minimization problem. In many cases, the signal sparsity and the recovery performance can be further improved by replacing the L1 norm with a…

Computation · Statistics 2012-08-06 M. Salman Asif , Justin Romberg

Active learning for regression reduces labeling costs by selecting the most informative samples. Improved Greedy Sampling is a prominent method that balances feature-space diversity and output-space uncertainty using a static,…

Machine Learning · Statistics 2026-03-12 Simon D. Nguyen , Troy Russo , Kentaro Hoffman , Tyler H. McCormick

Recovering jointly sparse signals in the multiple measurement vectors (MMV) setting is a fundamental problem in machine learning, but traditional methods often require careful parameter tuning or prior knowledge of the sparsity of the…

Machine Learning · Computer Science 2026-02-02 Lakshmi Jayalal , Sheetal Kalyani

Classification tasks require a balanced distribution of data to ensure the learner to be trained to generalize over all classes. In real-world datasets, however, the number of instances vary substantially among classes. This typically leads…

Machine Learning · Computer Science 2020-11-24 Joel Jang , Yoonjeon Kim , Kyoungho Choi , Sungho Suh

Transfer learning is an emerging paradigm for leveraging multiple sources to improve the statistical inference on a single target. In this paper, we propose a novel approach named residual importance weighted transfer learning (RIW-TL) for…

Methodology · Statistics 2024-01-04 Junlong Zhao , Shengbin Zheng , Chenlei Leng

We propose an embarrassingly simple method -- instance-aware repeat factor sampling (IRFS) to address the problem of imbalanced data in long-tailed object detection. Imbalanced datasets in real-world object detection often suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Burhaneddin Yaman , Tanvir Mahmud , Chun-Hao Liu