中文
相关论文

相关论文: A stochastic smoothing framework for nonconvex-non…

200 篇论文

We propose an adaptive smoothing algorithm based on Nesterov's smoothing technique in \cite{Nesterov2005c} for solving "fully" nonsmooth composite convex optimization problems. Our method combines both Nesterov's accelerated proximal…

最优化与控制 · 数学 2016-07-05 Quoc Tran-Dinh

Multi-modal distributions are commonly used to model clustered data in statistical learning tasks. In this paper, we consider the Mixed Linear Regression (MLR) problem. We propose an optimal transport-based framework for MLR problems,…

机器学习 · 统计学 2021-06-17 Theo Diamandis , Yonina C. Eldar , Alireza Fallah , Farzan Farnia , Asuman Ozdaglar

Distributionally Robust Optimization (DRO) has enabled to prove the equivalence between robustness and regularization in classification and regression, thus providing an analytical reason why regularization generalizes well in statistical…

最优化与控制 · 数学 2020-07-15 Esther Derman , Shie Mannor

We propose a Distributionally Robust Optimization (DRO) formulation with a Wasserstein-based uncertainty set for selecting grouped variables under perturbations on the data for both linear regression and classification problems. The…

机器学习 · 统计学 2020-06-12 Ruidi Chen , Ioannis Ch. Paschalidis

The use of min-max optimization in adversarial training of deep neural network classifiers and training of generative adversarial networks has motivated the study of nonconvex-nonconcave optimization objectives, which frequently arise in…

最优化与控制 · 数学 2021-03-02 Jelena Diakonikolas , Constantinos Daskalakis , Michael I. Jordan

We study a distributionally robust mean square error estimation problem over a nonconvex Wasserstein ambiguity set containing only normal distributions. We show that the optimal estimator and the least favorable distribution form a Nash…

Wasserstein distributionally robust control (WDRC) is an effective method for addressing inaccurate distribution information about disturbances in stochastic systems. It provides various salient features, such as an out-of-sample…

系统与控制 · 电气工程与系统科学 2022-09-08 Astghik Hakobyan , Insoon Yang

While many distributed optimization algorithms have been proposed for solving smooth or convex problems over the networks, few of them can handle non-convex and non-smooth problems. Based on a proximal primal-dual approach, this paper…

最优化与控制 · 数学 2021-09-01 Zhiguo Wang , Jiawei Zhang , Tsung-Hui Chang , Jian Li , Zhi-Quan Luo

Transfer learning is a popular strategy to leverage external knowledge and improve statistical efficiency, particularly with a limited target sample. We propose a novel knowledge-guided Wasserstein Distributionally Robust Optimization…

机器学习 · 计算机科学 2025-02-13 Zitao Wang , Ziyuan Wang , Molei Liu , Nian Si

We introduce a robust variant of the Kelly portfolio optimization model, called the Wasserstein-Kelly portfolio optimization. Our model, taking a Wasserstein distributionally robust optimization (DRO) formulation, addresses the fundamental…

投资组合管理 · 定量金融 2023-02-28 Jonathan Yu-Meng Li

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

机器学习 · 计算机科学 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

机器学习 · 计算机科学 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

We focus on a class of non-smooth optimization problems over the Stiefel manifold in the decentralized setting, where a connected network of $n$ agents cooperatively minimize a finite-sum objective function with each component being weakly…

最优化与控制 · 数学 2023-04-03 Jinxin Wang , Jiang Hu , Shixiang Chen , Zengde Deng , Anthony Man-Cho So

This work aims to solve a stochastic nonconvex nonsmooth composite optimization problem. Previous works on composite optimization problem requires the major part to satisfy Lipschitz smoothness or some relaxed smoothness conditions, which…

最优化与控制 · 数学 2025-10-07 Ziyi Chen , Peiran Yu , Heng Huang

This paper proposes a framework to study the convergence of stochastic optimization and learning algorithms. The framework is modeled over the different challenges that these algorithms pose, such as (i) the presence of random additive…

最优化与控制 · 数学 2024-07-01 Nicola Bastianello , Liam Madden , Ruggero Carli , Emiliano Dall'Anese

In this paper, we propose a practical online method for solving a class of distributionally robust optimization (DRO) with non-convex objectives, which has important applications in machine learning for improving the robustness of neural…

机器学习 · 计算机科学 2021-11-15 Qi Qi , Zhishuai Guo , Yi Xu , Rong Jin , Tianbao Yang

We aim to solve a structured convex optimization problem, where a nonsmooth function is composed with a linear operator. When opting for full splitting schemes, usually, primal-dual type methods are employed as they are effective and also…

最优化与控制 · 数学 2019-05-17 Radu Ioan Bot , Axel Böhm

We develop an inexact primal-dual first-order smoothing framework to solve a class of non-bilinear saddle point problems with primal strong convexity. Compared with existing methods, our framework yields a significant improvement over the…

最优化与控制 · 数学 2023-07-25 Le Thi Khanh Hien , Renbo Zhao , William B. Haskell

Building on a recent framework for distributionally robust optimization, we consider estimation of the inverse covariance matrix for multivariate data. We provide a novel notion of a Wasserstein ambiguity set specifically tailored to this…

机器学习 · 统计学 2019-10-08 Pedro Cisneros-Velarde , Sang-Yun Oh , Alexander Petersen

Distributionally robust optimization (DRO) is a widely-used approach to learn models that are robust against distribution shift. Compared with the standard optimization setting, the objective function in DRO is more difficult to optimize,…

机器学习 · 计算机科学 2021-10-27 Jikai Jin , Bohang Zhang , Haiyang Wang , Liwei Wang