English
Related papers

Related papers: Box constrained $\ell_1$ optimization in random li…

200 papers

We discuss a strategy of sparse approximation that is based on the use of an overcomplete basis, and evaluate its performance when a random matrix is used as this basis. A small combination of basis vectors is chosen from a given…

Information Theory · Computer Science 2016-06-29 Yoshinori Nakanishi-Ohno , Tomoyuki Obuchi , Masato Okada , Yoshiyuki Kabashima

This paper establishes a precise high-dimensional asymptotic theory for boosting on separable data, taking statistical and computational perspectives. We consider a high-dimensional setting where the number of features (weak learners) $p$…

Statistics Theory · Mathematics 2022-11-21 Tengyuan Liang , Pragya Sur

In this paper we deal with stochastic optimization problems where the data distributions change in response to the decision variables. Traditionally, the study of optimization problems with decision-dependent distributions has assumed…

Optimization and Control · Mathematics 2023-10-05 Zifan Wang , Changxin Liu , Thomas Parisini , Michael M. Zavlanos , Karl H. Johansson

Compressed sensing with sparse frame representations is seen to have much greater range of practical applications than that with orthonormal bases. In such settings, one approach to recover the signal is known as $\ell_1$-analysis. We…

Information Theory · Computer Science 2015-03-19 Yulong Liu , Tiebin Mi , Shidong Li

It has been observed that some working principles of evolutionary algorithms, in particular, the influence of the parameters, cannot be understood from results on the asymptotic order of the runtime, but only from more precise results. In…

Neural and Evolutionary Computing · Computer Science 2018-10-18 Benjamin Doerr , Carola Doerr , Jing Yang

We consider bounded extremum seeking controls for time-varying linear systems with uncertain coefficient matrices and measurement uncertainty. Using a new change of variables, Lyapunov functions, and a comparison principle, we provide…

Optimization and Control · Mathematics 2025-01-20 Frederic Mazenc , Michael Malisoff , Emilia Fridman

We propose a sampling-based trajectory optimization methodology for constrained problems. We extend recent works on stochastic search to deal with box control constraints,as well as nonlinear state constraints for discrete dynamical…

Optimization and Control · Mathematics 2019-11-13 George I. Boutselis , Ziyi Wang , Evangelos A. Theodorou

We study reinforcement learning with function approximation for large-scale Partially Observable Markov Decision Processes (POMDPs) where the state space and observation space are large or even continuous. Particularly, we consider Hilbert…

Machine Learning · Computer Science 2022-06-27 Masatoshi Uehara , Ayush Sekhari , Jason D. Lee , Nathan Kallus , Wen Sun

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. While naturally cast as a combinatorial optimization problem, variable or feature selection admits a convex relaxation through the…

Machine Learning · Computer Science 2012-04-23 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

Given an arbitrary set of high dimensional points in $\ell_1$, there are known negative results that preclude the possibility of always mapping them to a low dimensional $\ell_1$ space while preserving distances with small multiplicative…

Data Structures and Algorithms · Computer Science 2024-04-09 Moses Charikar , Spencer Compton , Chirag Pabbaraju

Consider the communication-constrained estimation of discrete distributions under $\ell^p$ losses, where each distributed terminal holds multiple independent samples and uses limited number of bits to describe the samples. We obtain the…

Machine Learning · Computer Science 2024-11-11 Deheng Yuan , Tao Guo , Zhongyi Huang

This paper studies an optimal control problem governed by a semilinear elliptic equation, in which the control acts in a multiplicative or bilinear way as the reaction coefficient of the equation. We focus on the numerical discretization of…

Optimization and Control · Mathematics 2025-06-25 Eduardo Casas , Konstantinos Chrysafinos , Mariano Mateos

Many optimally scaling quantum simulation algorithms employ controlled time evolution of the Hamiltonian, which is typically the major bottleneck for their efficient implementation. This work establishes a compression protocol for encoding…

Quantum Physics · Physics 2026-04-09 Erenay Karacan

We propose a new black-box complexity model for search algorithms evaluating $\lambda$ search points in parallel. The parallel unary unbiased black-box complexity gives lower bounds on the number of function evaluations every parallel unary…

Neural and Evolutionary Computing · Computer Science 2019-02-04 Per Kristian Lehre , Dirk Sudholt

The paper suggests a generalization of the Sign-Perturbed Sums (SPS) finite sample system identification method for the identification of closed-loop observable stochastic linear systems in state-space form. The solution builds on the…

Systems and Control · Electrical Eng. & Systems 2024-06-11 Szabolcs Szentpéteri , Balázs Csanád Csáji

Based on our \bl{\textbf{Random Duality Theory (RDT)}}, in a sequence of our recent papers \cite{Stojnicclupint19,Stojnicclupcmpl19,Stojnicclupplt19}, we introduced a powerful algorithmic mechanism (called \bl{\textbf{CLuP}}) that can be…

Information Theory · Computer Science 2020-11-24 Mihailo Stojnic

We generalize the topological response theory to detect the boundary anomalies of linear subsystem symmetries. This approach allows us to distinguish different subsystem symmetry-protected topological (SSPT) phases and uncover new ones. We…

Strongly Correlated Electrons · Physics 2025-05-20 Ke Ding , Hao-Ran Zhang , Bai-Ting Liu , Shuo Yang

In this letter, we consider the problem of recovering an unknown sparse signal from noisy linear measurements, using an enhanced version of the popular Elastic-Net (EN) method. We modify the EN by adding a box-constraint, and we call it the…

Machine Learning · Computer Science 2021-07-06 Ayed M. Alrashdi , Ismail Ben Atitallah , Tareq Y. Al-Naffouri

This paper investigates two related optimal input selection problems for fixed (non-switched) and switched structured systems. More precisely, we consider selecting the minimum cost of inputs from a prior set of inputs, and selecting the…

Systems and Control · Electrical Eng. & Systems 2022-10-20 Yuan Zhang , Yuanqing Xia , Shenyu Liu , Zhongqi Sun

Understanding how the optimal value of an optimisation problem changes when its input data is modified is an old question in mathematical optimisation. This paper investigates the computation of the optimal values of a family of (possibly…

Optimization and Control · Mathematics 2026-03-02 Guillaume Derval , Damien Ernst , Quentin Louveaux , Bardhyl Miftari