English
Related papers

Related papers: A Unifying Framework for Variance Reduction Algori…

200 papers

This paper presents a new algorithmic framework for computing sparse solutions to large-scale linear discrete ill-posed problems. The approach is motivated by recent perspectives on iteratively reweighted norm schemes, viewed through the…

Numerical Analysis · Mathematics 2025-02-05 Lucas Onisk , Malena Sabaté Landman

Recently, Sidford, Wang, Wu and Ye (2018) developed an algorithm combining variance reduction techniques with value iteration to solve discounted Markov decision processes. This algorithm has a sublinear complexity when the discount factor…

Optimization and Control · Mathematics 2019-09-16 Marianne Akian , Stéphane Gaubert , Zheng Qu , Omar Saadi

We present a primal-dual algorithmic framework to obtain approximate solutions to a prototypical constrained convex optimization problem, and rigorously characterize how common structural assumptions affect the numerical efficiency. Our…

Optimization and Control · Mathematics 2015-03-04 Quoc Tran-Dinh , Volkan Cevher

We consider fair resource allocation in sequential decision-making environments modeled as weakly coupled Markov decision processes, where resource constraints couple the action spaces of $N$ sub-Markov decision processes (sub-MDPs) that…

Machine Learning · Computer Science 2025-04-29 Xiaohui Tu , Yossiri Adulyasak , Nima Akbarzadeh , Erick Delage

We consider a stochastic variant of the packing-type integer linear programming problem, which contains random variables in the objective vector. We are allowed to reveal each entry of the objective vector by conducting a query, and the…

Data Structures and Algorithms · Computer Science 2019-03-14 Takanori Maehara , Yutaro Yamaguchi

For the inclusion problem involving two maximal monotone operators, under the metric subregularity of the composite operator, we derive the linear convergence of the generalized proximal point algorithm and several splitting algorithms,…

Optimization and Control · Mathematics 2016-09-28 Li Shen , Shaohua Pan

This paper addresses constrained smooth saddle-point problems in settings where projection onto the feasible sets is computationally expensive. We bridge the gap between projection-based and projection-free optimization by introducing a…

Optimization and Control · Mathematics 2026-04-02 Khanh-Hung Giang-Tran , Soroosh Shafiee , Nam Ho-Nguyen

Minimizing finite sums of functions is a central problem in optimization, arising in numerous practical applications. Such problems are commonly addressed using first-order optimization methods. However, these procedures cannot be used in…

Optimization and Control · Mathematics 2025-07-01 Marco Rando , Cheik Traoré , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

Pareto optimization via evolutionary multi-objective algorithms has been shown to efficiently solve constrained monotone submodular functions. Traditionally when solving multiple problems, the algorithm is run for each problem separately.…

Neural and Evolutionary Computing · Computer Science 2026-04-17 Liam Wigney , Frank Neumann

We study in this paper a forward-backward-forward dynamical system for solving a mixed variational inequality problem in a real Hilbert space. For the convergence analysis of our proposed system, we apply the Lyapunov analysis to obtain the…

Optimization and Control · Mathematics 2025-11-25 Chidi Elijah Nwakpa , Chinedu Izuchukwu , Chibueze Christian Okeke

This paper develops a unified framework for zero-sum games in which both the pure strategies and the payoff matrices contain complex-valued entries. By leveraging a linear isomorphism between complex and real vector spaces, we extend key…

General Mathematics · Mathematics 2026-05-21 Raneem Madani , Abdel Lisser , Zeno Toffano

An algorithm framework is proposed for minimizing nonsmooth functions. The framework is variable-metric in that, in each iteration, a step is computed using a symmetric positive definite matrix whose value is updated as in a quasi-Newton…

Optimization and Control · Mathematics 2019-02-05 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We present a centralized algorithmic framework for solving multi-robot path planning problems in general, two-dimensional, continuous environments while minimizing globally the task completion time. The framework obtains high levels of…

Robotics · Computer Science 2015-07-14 Jingjin Yu , Daniela Rus

The standard algorithms for solving large-scale convex-concave saddle point problems, or, more generally, variational inequalities with monotone operators, are proximal type algorithms which at every iteration need to compute a…

Optimization and Control · Mathematics 2014-06-24 Anatoli Juditsky , Arkadi Nemirovski

The splitting algorithms of monotone operator theory find zeros of sums of relations. This corresponds to solving series or parallel one-port electrical circuits, or the negative feedback interconnection of two subsystems. One-port circuits…

Optimization and Control · Mathematics 2022-08-10 Thomas Chaffey , Amritam Das , Rodolphe Sepulchre

We propose a proximal variable smoothing algorithm for nonsmooth optimization problem with sum of three functions involving weakly convex composite function. The proposed algorithm is designed as a time-varying forward-backward splitting…

Optimization and Control · Mathematics 2025-04-29 Keita Kume , Isao Yamada

Stochastic variance reduced methods have gained a lot of interest recently for empirical risk minimization due to its appealing run time complexity. When the data size is large and disjointly stored on different machines, it becomes…

Machine Learning · Computer Science 2020-08-26 Shicong Cen , Huishuai Zhang , Yuejie Chi , Wei Chen , Tie-Yan Liu

We propose an enhanced zeroth-order stochastic Frank-Wolfe framework to address constrained finite-sum optimization problems, a structure prevalent in large-scale machine-learning applications. Our method introduces a novel double variance…

Machine Learning · Computer Science 2025-01-24 Haishan Ye , Yinghui Huang , Hao Di , Xiangyu Chang

We present a method for synthesizing dynamic, reduced-order output-feedback polynomial control policies for control-affine nonlinear systems which guarantees runtime stability to a goal state, when using visual observations and a learned…

Robotics · Computer Science 2023-09-29 Glen Chou , Russ Tedrake

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov