English
Related papers

Related papers: Wasserstein Distributionally Robust Multiclass Sup…

200 papers

This paper discusses a class of combinatorial optimization problems with uncertain costs in the objective function. It is assumed that a sample of the cost realizations is available, which defines an empirical probability distribution for…

Optimization and Control · Mathematics 2023-12-21 Marcel Jackiewicz , Adam Kasperski , Pawel Zielinski

The problem of quickest detection of a change in the distribution of a sequence of independent observations is considered. It is assumed that the pre-change distribution is known (accurately estimated), while the only information about the…

Statistics Theory · Mathematics 2023-09-29 Liyan Xie , Yuchen Liang , Venugopal V. Veeravalli

Complementary-label learning (CLL) is widely used in weakly supervised classification, but it faces a significant challenge in real-world datasets when confronted with class-imbalanced training samples. In such scenarios, the number of…

Machine Learning · Computer Science 2024-03-21 Meng Wei , Yong Zhou , Zhongnian Li , Xinzheng Xu

Support vector machine (SVM) is one of the most popular classification algorithms in the machine learning literature. We demonstrate that SVM can be used to balance covariates and estimate average causal effects under the unconfoundedness…

Methodology · Statistics 2021-07-02 Alexander Tarr , Kosuke Imai

One Class Slab Support Vector Machines (OCSSVM) have turned out to be better in terms of accuracy in certain classes of classification problems than the traditional SVMs and One Class SVMs or even other One class classifiers. This paper…

Machine Learning · Computer Science 2024-09-05 Bagesh Kumar , Ayush Sinha , Sourin Chakrabarti , O. P. Vyas

A data-driven MPC scheme is proposed to safely control constrained stochastic linear systems using distributionally robust optimization. Distributionally robust constraints based on the Wasserstein metric are imposed to bound the state…

Optimization and Control · Mathematics 2021-05-19 Zhengang Zhong , Ehecatl Antonio del Rio-Chanona , Panagiotis Petsagkourakis

We present a Distributionally Robust Optimization (DRO) approach to estimate a robustified regression plane in a linear regression setting, when the observed samples are potentially contaminated with adversarially corrupted outliers. Our…

Machine Learning · Statistics 2018-05-14 Ruidi Chen , Ioannis Ch. Paschalidis

Separating audio mixtures into individual instrument tracks has been a long standing challenging task. We introduce a novel weakly supervised audio source separation approach based on deep adversarial learning. Specifically, our loss…

Sound · Computer Science 2018-05-18 Ning Zhang , Junchi Yan , Yuchen Zhou

We present the first minimax risk bounds for estimators of the spectral measure in multivariate linear factor models, where observations are linear combinations of regularly varying latent factors. Non-asymptotic convergence rates are…

Statistics Theory · Mathematics 2024-11-12 Xuhui Zhang , Jose Blanchet , Youssef Marzouk , Viet Anh Nguyen , Sven Wang

Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and…

Machine Learning · Computer Science 2024-02-20 Huafeng Liu , Mengmeng Sheng , Zeren Sun , Yazhou Yao , Xian-Sheng Hua , Heng-Tao Shen

The multiple measurement vector (MMV) problem addresses the identification of unknown input vectors that share common sparse support. Even though MMV problems had been traditionally addressed within the context of sensor array signal…

Information Theory · Computer Science 2011-04-05 Jong Min Kim , Ok Kyun Lee , Jong Chul Ye

Using only retrospective data, we study the problem of predicting treatment effects for the same treatment/policy implemented in a different location or time period. We propose a distributionally robust estimator that minimizes the…

Econometrics · Economics 2026-04-29 Ruonan Xu , Xiye Yang

Consider the supervised learning setting where the goal is to learn to predict labels $\mathbf y$ given points $\mathbf x$ from a distribution. An \textit{omnipredictor} for a class $\mathcal L$ of loss functions and a class $\mathcal C$ of…

Machine Learning · Computer Science 2024-01-29 Parikshit Gopalan , Princewill Okoroafor , Prasad Raghavendra , Abhishek Shetty , Mihir Singhal

This paper addresses a novel \emph{cost-sensitive} distributionally robust log-optimal portfolio problem, where the investor faces \emph{ambiguous} return distributions, and a general convex transaction cost model is incorporated. The…

Optimization and Control · Mathematics 2024-11-01 Chung-Han Hsieh , Xiao-Rou Yu

The Support Vector Machine (SVM) is one of the most widely used classification methods. In this paper, we consider the soft-margin SVM used on data points with independent features, where the sample size $n$ and the feature dimension $p$…

Machine Learning · Statistics 2019-08-02 Haoyang Liu

We consider the rate-distortion function for lossy source compression, as well as the channel capacity for error correction, through the lens of distributional robustness. We assume that the distribution of the source or of the additive…

Information Theory · Computer Science 2024-05-14 Vikrant Malik , Taylan Kargin , Victoria Kostina , Babak Hassibi

We study data-driven decision problems where historical observations are generated by a time-evolving distribution whose consecutive shifts are bounded in Wasserstein distance. We address this nonstationarity using a distributionally robust…

Optimization and Control · Mathematics 2025-12-25 Dominic S. T. Keehan , Edward J. Anderson , Wolfram Wiesemann

Despite the success of deep neural networks in medical image classification, the problem remains challenging as data annotation is time-consuming, and the class distribution is imbalanced due to the relative scarcity of diseases. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zhongzheng Huang , Jiawei Wu , Tao Wang , Zuoyong Li , Anastasia Ioannou

Traditionally, data valuation (DV) is posed as a problem of equitably splitting the validation performance of a learning algorithm among the training data. As a result, the calculated data values depend on many design choices of the…

Machine Learning · Computer Science 2023-12-21 Hoang Anh Just , Feiyang Kang , Jiachen T. Wang , Yi Zeng , Myeongseob Ko , Ming Jin , Ruoxi Jia

As opposed to standard empirical risk minimization (ERM), distributionally robust optimization aims to minimize the worst-case risk over a larger ambiguity set containing the original empirical distribution of the training data. In this…

Machine Learning · Computer Science 2021-01-06 Jaeho Lee , Maxim Raginsky