English
Related papers

Related papers: Self-improving Algorithms for Coordinate-wise Maxi…

200 papers

Decision trees are a popular machine learning model which are traditionally trained by heuristic methods. Massive improvements in computing power and optimisation techniques has led to renewed interest in learning globally optimal decision…

Optimization and Control · Mathematics 2025-11-25 Mitchell Keegan , Michael Forbes , Paul Corry , Mahdi Abolghasemi

In this paper, we consider a network of processors aiming at cooperatively solving mixed-integer convex programs subject to uncertainty. Each node only knows a common cost function and its local uncertain constraint set. We propose a…

Optimization and Control · Mathematics 2022-07-19 Mohammadreza Chamanbaz , Giuseppe Notarstefano , Francesco Sasso , Roland Bouffanais

We study a ranking and selection (R&S) problem when all solutions share common parametric Bayesian input models updated with the data collected from multiple independent data-generating sources. Our objective is to identify the best system…

Methodology · Statistics 2025-02-25 Eunhye Song , Taeho Kim

We expose in a tutorial fashion the mechanisms which underlie the synthesis of optimization algorithms based on dynamic integral quadratic constraints. We reveal how these tools from robust control allow to design accelerated gradient…

Optimization and Control · Mathematics 2023-09-18 Carsten W. Scherer , Christian Ebenbauer , Tobias Holicki

We study local computation algorithms (LCA) for maximum matching. An LCA does not return its output entirely, but reveals parts of it upon query. For matchings, each query is a vertex $v$; the LCA should return whether $v$ is matched -- and…

Data Structures and Algorithms · Computer Science 2023-11-17 Soheil Behnezhad , Mohammad Roghani , Aviad Rubinstein

Treemaps have been widely applied to the visualization of hierarchical data. A treemap takes a weighted tree and visualizes its leaves in a nested planar geometric shape, with sub-regions partitioned such that each sub-region has an area…

Graphics · Computer Science 2023-09-01 Mehdi Behroozi , Reyhaneh Mohammadi , Cody Dunne

The pathwise coordinate optimization is one of the most important computational frameworks for high dimensional convex and nonconvex sparse learning problems. It differs from the classical coordinate optimization algorithms in three salient…

Machine Learning · Statistics 2017-06-06 Tuo Zhao , Han Liu , Tong Zhang

We develop and analyse an approach to optimize functions $l\colon \mathbb{R}^d \rightarrow \mathbb{R}$ not assumed to be convex, differentiable or even continuous. The algorithm belongs to the class of model-based search methods. The idea…

Computation · Statistics 2025-12-04 Christophe Andrieu , Nicolas Chopin , Ettore Fincato , Mathieu Gerber

Suppose one has a collection of parameters indexed by a (possibly infinite dimensional) set. Given data generated from some distribution, the objective is to estimate the maximal parameter in this collection evaluated at this distribution.…

Methodology · Statistics 2016-05-26 Alexander R. Luedtke , Mark J. van der Laan

We study the problem of distributed mean estimation and optimization under communication constraints. We propose a correlated quantization protocol whose leading term in the error guarantee depends on the mean deviation of data points…

Machine Learning · Computer Science 2022-07-12 Ananda Theertha Suresh , Ziteng Sun , Jae Hun Ro , Felix Yu

This work presents a novel algorithm for impulsive optimal control of linear time-varying systems with the inclusion of input magnitude constraints. Impulsive optimal control problems, where the optimal input solution is a sum of delta…

Optimization and Control · Mathematics 2026-03-17 Ethan Foss , Simone D'Amico

The increasing penetration of renewables in distribution networks calls for faster and more advanced voltage regulation strategies. A promising approach is to formulate the problem as an optimization problem, where the optimal reactive…

Optimization and Control · Mathematics 2020-02-24 Yize Chen , Yuanyuan Shi , Baosen Zhang

The orienteering problem is a route optimization problem which consists in finding a simple cycle that maximizes the total collected profit subject to a maximum distance limitation. In the last few decades, the occurrence of this problem in…

Optimization and Control · Mathematics 2021-01-14 Gorka Kobeaga , María Merino , Jose A. Lozano

Tasks in multi-task learning often correlate, conflict, or even compete with each other. As a result, a single solution that is optimal for all tasks rarely exists. Recent papers introduced the concept of Pareto optimality to this field and…

Machine Learning · Computer Science 2020-08-28 Pingchuan Ma , Tao Du , Wojciech Matusik

The perspective of developing trustworthy AI for critical applications in science and engineering requires machine learning techniques that are capable of estimating their own uncertainty. In the context of regression, instead of estimating…

Machine Learning · Computer Science 2026-05-14 Quentin Duchemin , Guillaume Obozinski

To cope with fast-fluctuating distributed energy resources (DERs) and uncontrolled loads, this paper formulates a time-varying optimization problem for distribution grids with DERs and develops a novel non-iterative algorithm to track the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 J. Wu , M. Liu , W. Lu , K. Xie , M. Xie

We consider the communication complexity of a number of distributed optimization problems. We start with the problem of solving a linear system. Suppose there is a coordinator together with $s$ servers $P_1, \ldots, P_s$, the $i$-th of…

Data Structures and Algorithms · Computer Science 2019-11-01 Santosh S. Vempala , Ruosong Wang , David P. Woodruff

Consider a polynomial optimisation problem, whose instances vary continuously over time. We propose to use a coordinate-descent algorithm for solving such time-varying optimisation problems. In particular, we focus on relaxations of…

Optimization and Control · Mathematics 2019-09-24 Jie Liu , Jakub Marecek , Andrea Simonetto , Martin Takac

We study how to construct compressed datasets that suffice to recover optimal decisions in linear programs with an unknown cost vector $c$ lying in a prior set $\mathcal{C}$. Recent work by Bennouna et al. provides an exact geometric…

Optimization and Control · Mathematics 2026-05-25 Yuhan Ye , Saurabh Amin , Asuman Ozdaglar

We study the problem of estimating the covariance matrix of a high-dimensional distribution when a small constant fraction of the samples can be arbitrarily corrupted. Recent work gave the first polynomial time algorithms for this problem…

Machine Learning · Computer Science 2019-06-12 Yu Cheng , Ilias Diakonikolas , Rong Ge , David Woodruff