English
Related papers

Related papers: Sparse polynomial approximation for optimal contro…

200 papers

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

Multivariate global polynomial approximations - such as polynomial chaos or stochastic collocation methods - are now in widespread use for sensitivity analysis and uncertainty quantification. The pseudospectral variety of these methods uses…

Numerical Analysis · Mathematics 2013-04-09 Paul G. Constantine , Michael S. Eldred , Eric T. Phipps

We consider the control of semilinear stochastic partial differential equations (SPDEs) via deterministic controls. In the case of multiplicative noise, existence of optimal controls and necessary conditions for optimality are derived. In…

Optimization and Control · Mathematics 2021-10-28 Wilhelm Stannat , Lukas Wessels

We provide a modified augmented Lagrange method coupled with a Tikhonov regularization for solving ill-posed state-constrained elliptic optimal control problems with sparse controls. We consider a linear quadratic optimal control problem…

Optimization and Control · Mathematics 2017-08-14 Veronika Karl , Frank Pörner

We propose a probabilistic framework for interpreting and developing hard thresholding sparse signal reconstruction methods and present several new algorithms based on this framework. The measurements follow an underdetermined linear model,…

Information Theory · Computer Science 2010-11-08 Kun Qiu , Aleksandar Dogandzic

While semidefinite programming (SDP) problems are polynomially solvable in theory, it is often difficult to solve large SDP instances in practice. One technique to address this issue is to relax the global positive-semidefiniteness (PSD)…

Optimization and Control · Mathematics 2020-02-11 Grigoriy Blekherman , Santanu S. Dey , Marco Molinaro , Shengding Sun

Sparse and convolutional constraints form a natural prior for many optimization problems that arise from physical processes. Detecting motifs in speech and musical passages, super-resolving images, compressing videos, and reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2014-06-11 Hilton Bristow , Simon Lucey

In an effort to develop an alternative approach to traditional sparse reformulations, we will provide a new type of convex reformulation of a large class of stochastic quadratically constrained quadratic optimization problems that is…

Optimization and Control · Mathematics 2023-01-31 Markus Gabl

We consider and analyze applying a spectral inverse iteration algorithm and its subspace iteration variant for computing eigenpairs of an elliptic operator with random coefficients. With these iterative algorithms the solution is sought…

Numerical Analysis · Computer Science 2017-06-16 Harri Hakula , Mikael Laaksonen

Building on previous research which generalized multilevel Monte Carlo methods using either sparse grids or Quasi-Monte Carlo methods, this paper considers the combination of all these ideas applied to elliptic PDEs with finite-dimensional…

Numerical Analysis · Mathematics 2017-11-08 Michael B. Giles , Frances Y. Kuo , Ian H. Sloan

Sparse Principal Component Analysis (SPCA) is a fundamental technique for dimensionality reduction, and is NP-hard. In this paper, we introduce a randomized approximation algorithm for SPCA, which is based on the basic SDP relaxation. Our…

Machine Learning · Statistics 2026-05-19 Alberto Del Pia , Dekun Zhou

We propose algorithms for solving high-dimensional Partial Differential Equations (PDEs) that combine a probabilistic interpretation of PDEs, through Feynman-Kac representation, with sparse interpolation. Monte-Carlo methods and…

Numerical Analysis · Mathematics 2022-03-25 Marie Billaud-Friess , Arthur Macherey , Anthony Nouy , Clémentine Prieur

We consider a distributed optimal control problem governed by an elliptic PDE, and propose an embedded discontinuous Galerkin (EDG) method to approximate the solution. We derive optimal a priori error estimates for the state, dual state,…

Numerical Analysis · Mathematics 2018-07-25 Xiao Zhang , Yangwen Zhang , John R. Singler

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

Machine Learning · Statistics 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

This paper presents the design and analysis of a Hybrid High-Order (HHO) approximation for a distributed optimal control problem governed by the Poisson equation. We propose three distinct schemes to address unconstrained control problems…

Numerical Analysis · Mathematics 2025-01-14 Gouranga Mallik , Ramesh Chandra Sau

We show that a second order sufficient condition for local optimality, along with a strict complementarity condition, is enough to get the superlinear convergence of the semismooth Newton method for an optimal control problem governed by a…

Optimization and Control · Mathematics 2025-06-25 Casas Eduardo , Mateos Mariano

This paper considers stochastic optimization problems with weakly convex objective and constraint functions. We propose Prox-PEP, a proximal method equipped with quadratic subproblems. To handle nonlinear equality constraints, we employ an…

Optimization and Control · Mathematics 2026-05-11 Lixin Tang , Xingyu Wang , Liwei Zhang

Proximal gradient methods are popular in sparse optimization as they are straightforward to implement. Nevertheless, they achieve biased solutions, requiring many iterations to converge. This work addresses these issues through a suitable…

Optimization and Control · Mathematics 2025-04-18 V. Cerone , S. M. Fosson , A. Re , D. Regruto

Surrogate modeling of costly mathematical models representing physical systems is challenging since it is typically not possible to create a large experimental design. Thus, it is beneficial to constrain the approximation to adhere to the…

Machine Learning · Computer Science 2023-09-06 Lukáš Novák , Himanshu Sharma , Michael D. Shields

We present estimators for a well studied statistical estimation problem: the estimation for the linear regression model with soft sparsity constraints ($\ell_q$ constraint with $0<q\leq1$) in the high-dimensional setting. We first present a…

Statistics Theory · Mathematics 2013-11-11 Li Zhang