English
Related papers

Related papers: Wasserstein Distributionally Robust Multiclass Sup…

200 papers

The support vector machine (SVM) is one of the most successful learning methods for solving classification problems. Despite its popularity, SVM has a serious drawback, that is sensitivity to outliers in training samples. The penalty on…

Machine Learning · Statistics 2014-09-04 Takafumi Kanamori , Shuhei Fujiwara , Akiko Takeda

Despite their empirical success, most existing listwiselearning-to-rank (LTR) models are not built to be robust to errors in labeling or annotation, distributional data shift, or adversarial data perturbations. To fill this gap, we…

Machine Learning · Computer Science 2021-09-28 Shahabeddin Sotudian , Ruidi Chen , Ioannis Paschalidis

We present a distributionally robust formulation of a stochastic optimization problem for non-i.i.d vector autoregressive data. We use the Wasserstein distance to define robustness in the space of distributions and we show, using duality…

Optimization and Control · Mathematics 2019-09-10 Xialiang Dou , Mihai Anitescu

We consider distributionally robust optimization problems where the uncertainty is modeled via a structured Wasserstein ambiguity set. Specifically, the ambiguity is restricted to product measures $P^{\otimes N}$, where $P$ lies within a…

Optimization and Control · Mathematics 2026-04-14 Andrey Kharitenko , Marta Fochesato , Anastasios Tsiamis , Niklas Schmid , John Lygeros

We study distributionally robust online learning, where a risk-averse learner updates decisions sequentially to guard against worst-case distributions drawn from a Wasserstein ambiguity set centered at past observations. While this paradigm…

Machine Learning · Computer Science 2026-02-25 Guixian Chen , Salar Fattahi , Soroosh Shafiee

Several works have addressed the problem of incorporating constraints in the reinforcement learning (RL) framework, however majority of them can only guarantee the satisfaction of soft constraints. In this work, we address the problem of…

Machine Learning · Computer Science 2020-06-16 Kwangyeon Kim , Akshita Gupta , Hong-Cheol Choi , Inseok Hwang

In many practical applications of machine learning, a discrepancy often arises between a source distribution from which labeled training examples are drawn and a target distribution for which only unlabeled data is observed. Traditionally,…

Machine Learning · Statistics 2025-03-05 Paweł Teisseyre , Jan Mielniczuk

Distributionally robust control (DRC) aims to effectively manage distributional ambiguity in stochastic systems. While most existing works address inaccurate distributional information in fully observable settings, we consider a partially…

Systems and Control · Electrical Eng. & Systems 2022-12-23 Astghik Hakobyan , Insoon Yang

Support vector machine (SVM) has been one of the most popular learning algorithms, with the central idea of maximizing the minimum margin, i.e., the smallest distance from the instances to the classification boundary. Recent theoretical…

Machine Learning · Computer Science 2020-07-07 Teng Zhang , Zhi-Hua Zhou

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

Machine Learning · Computer Science 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos

This study addresses a class of linear mixed-integer programming (MILP) problems that involve uncertainty in the objective function parameters. The parameters are assumed to form a random vector, whose probability distribution can only be…

Optimization and Control · Mathematics 2024-03-07 Sergey S. Ketkov

A general approach for anomaly detection or novelty detection consists in estimating high density regions or Minimum Volume (MV) sets. The One-Class Support Vector Machine (OCSVM) is a state-of-the-art algorithm for estimating such regions…

Machine Learning · Statistics 2015-09-01 Albert Thomas , Vincent Feuillard , Alexandre Gramfort

Support vector machines (SVMs) are well-studied supervised learning models for binary classification. In many applications, large amounts of samples can be cheaply and easily obtained. What is often a costly and error-prone process is to…

Optimization and Control · Mathematics 2024-12-20 Veronica Piccialli , Jan Schwiddessen , Antonio M. Sudoso

Assume that we observe i.i.d.~points lying close to some unknown $d$-dimensional $\mathcal{C}^k$ submanifold $M$ in a possibly high-dimensional space. We study the problem of reconstructing the probability distribution generating the…

Statistics Theory · Mathematics 2022-02-15 Vincent Divol

Classification is one of the main areas of pattern recognition research, and within it, Support Vector Machine (SVM) is one of the most popular methods outside of field of deep learning -- and a de-facto reference for many Machine Learning…

Machine Learning · Computer Science 2024-02-23 Michał Cholewa , Michał Romaszewski , Przemysław Głomb

Often, when dealing with real-world recognition problems, we do not need, and often cannot have, knowledge of the entire set of possible classes that might appear during operational testing. In such cases, we need to think of robust…

Machine Learning · Computer Science 2022-02-23 Pedro Ribeiro Mendes Júnior , Terrance E. Boult , Jacques Wainer , Anderson Rocha

Existing work within transfer learning often follows a two-step process -- pre-training over a large-scale source domain and then finetuning over limited samples from the target domain. Yet, despite its popularity, this methodology has been…

Machine Learning · Computer Science 2025-01-03 Akul Goyal , Carl Edwards

We present a data-driven approach for distributionally robust chance constrained optimization problems (DRCCPs). We consider the case where the decision maker has access to a finite number of samples or realizations of the uncertainty. The…

Optimization and Control · Mathematics 2018-10-11 Ashish R. Hota , Ashish Cherukuri , John Lygeros

We consider the problem of learning support vector machines robust to uncertainty. It has been established in the literature that typical loss functions, including the hinge loss, are sensible to data perturbations and outliers, thus…

Machine Learning · Computer Science 2024-02-06 Valentina Cepeda , Andrés Gómez , Shaoning Han

We study distribution-on-distribution regression problems in which a response distribution depends on multiple distributional predictors. Such settings arise naturally in applications where the outcome distribution is driven by several…

Methodology · Statistics 2026-01-08 Yuanying Chen , Tongyu Li , Yang Bai , Zhenhua Lin