English
Related papers

Related papers: High-dimensional Black-box Optimization via Divide…

200 papers

We consider a dynamic programming (DP) approach to approximately solving an infinite-horizon constrained Markov decision process (CMDP) problem with a fixed initial-state for the expected total discounted-reward criterion with a…

Optimization and Control · Mathematics 2023-08-08 Hyeong Soo Chang

For dense Hermitian matrices with small off-diagonal (numerical) ranks and in a hierarchically semiseparable form, we give a stable divide-and-conquer eigendecomposition method with nearly linear complexity (called SuperDC) that…

Numerical Analysis · Mathematics 2021-08-10 Xiaofeng Ou , Jianlin Xia

This paper was prompted by numerical experiments we performed, in which algorithms already available in the literature (DVS-BDDM) yielded accelerations (or speedups) many times larger (more than seventy in some examples already treated, but…

Computational Engineering, Finance, and Science · Computer Science 2024-12-20 Ismael Herrera-Revilla , Iván Contreras , Graciela S. Herrera

This dissertation explores block decomposable methods for large-scale optimization problems. It focuses on alternating direction method of multipliers (ADMM) schemes and block coordinate descent (BCD) methods. Specifically, it introduces a…

Optimization and Control · Mathematics 2026-01-15 Leandro Farias Maia

Motivated by the need for decentralized learning, this paper aims at designing a distributed algorithm for solving nonconvex problems with general linear constraints over a multi-agent network. In the considered problem, each agent owns…

Optimization and Control · Mathematics 2022-06-23 Jiawei Zhang , Songyang Ge , Tsung-Hui Chang , Zhi-Quan Luo

We consider the problem of decomposing a multivariate polynomial as the difference of two convex polynomials. We introduce algebraic techniques which reduce this task to linear, second order cone, and semidefinite programming. This allows…

Optimization and Control · Mathematics 2018-09-13 Amir Ali Ahmadi , Georgina Hall

This work is concerned with approximating matrix functions for banded matrices, hierarchically semiseparable matrices, and related structures. We develop a new divide-and-conquer method based on (rational) Krylov subspace methods for…

Numerical Analysis · Mathematics 2021-07-12 Alice Cortinovis , Daniel Kressner , Stefano Massei

Conic programming has well-documented merits in a gamut of signal processing and machine learning tasks. This contribution revisits a recently developed first-order conic descent (CD) solver, and advances it in three aspects: intuition,…

Optimization and Control · Mathematics 2023-08-16 Bingcong Li , Georgios B. Giannakis

In this paper, we study possible extensions of the main ideas and methods of constrained DC optimization to the case of nonlinear semidefinite programming problems and more general nonlinear and nonsmooth cone constrained optimization…

Optimization and Control · Mathematics 2024-04-23 M. V. Dolgopolik

Given a rectangle $R$ with area $A$ and a set of areas $L=\{A_1,...,A_n\}$ with $\sum_{i=1}^n A_i = A$, we consider the problem of partitioning $R$ into $n$ sub-regions $R_1,...,R_n$ with areas $A_1,...,A_n$ in a way that the total…

Optimization and Control · Mathematics 2023-09-06 Reyhaneh Mohammadi , Mehdi Behroozi

High-dimensional action spaces remain a challenge for dynamic algorithm configuration (DAC). Interdependencies and varying importance between action dimensions are further known key characteristics of DAC problems. We argue that these…

Machine Learning · Computer Science 2024-09-18 Philipp Bordne , M. Asif Hasan , Eddie Bergman , Noor Awad , André Biedenkapp

We consider the learning of algorithmic tasks by mere observation of input-output pairs. Rather than studying this as a black-box discrete regression problem with no assumption whatsoever on the input-output mapping, we concentrate on tasks…

Machine Learning · Computer Science 2018-10-16 Alex Nowak-Vila , David Folqué , Joan Bruna

This article explores distributed convex optimization with globally-coupled constraints, where the objective function is a general nonsmooth convex function, the constraints include nonlinear inequalities and affine equalities, and the…

Optimization and Control · Mathematics 2025-03-14 Zixuan Liu , Xuyang Wu , Dandan Wang , Jie Lu

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

In the paper, the global optimization problem of a multidimensional "black-box" function satisfying the Lipschitz condition over a hyperinterval with an unknown Lipschitz constant is considered. A new efficient algorithm for solving this…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Dmitri E. Kvasov

Structured optimization problems are ubiquitous in fields like data science and engineering. The goal in structured optimization is using a prescribed set of points, called atoms, to build up a solution that minimizes or maximizes a given…

Optimization and Control · Mathematics 2021-01-14 Andrea Cristofari , Francesco Rinaldi

We propose a novel decomposition framework for the distributed optimization of Difference Convex (DC)-type nonseparable sum-utility functions subject to coupling convex constraints. A major contribution of the paper is to develop for the…

Information Theory · Computer Science 2013-09-23 Alberth Alvarado , Gesualdo Scutari , Jong-Shi Pang

In this paper, we consider networks with topologies described by some connected undirected graph ${\mathcal{G}}=(V, E)$ and with some agents (fusion centers) equipped with processing power and local peer-to-peer communication, and…

Optimization and Control · Mathematics 2021-12-07 Nazar Emirov , Guohui Song , Qiyu Sun

Approximate Computing (AC) has emerged as a promising technique for achieving energy-efficient architectures and is expected to become an effective technique for reducing the electricity cost for cloud service providers (CSP). However, the…

Cryptography and Security · Computer Science 2024-05-27 Ye Wang , Jian Dong , Ming Han , Jin Wu , Gang Qu

Hyperdimensional computing (HDC) is emerging as a promising AI approach that can effectively target TinyML applications thanks to its lightweight computing and memory requirements. Previous works on HDC showed that limiting the standard 10k…

Performance · Computer Science 2024-04-02 Flavio Ponzina , Tajana Rosing