English
Related papers

Related papers: Structured Backward Errors of Sparse Generalized S…

200 papers

This paper studies Graphical SLOPE for precision matrix estimation, with emphasis on its ability to recover both sparsity and clusters of edges with equal or similar strength. In a fixed-dimensional regime, we establish that the root-$n$…

Statistics Theory · Mathematics 2026-04-15 Ivan Hejný , Giovanni Bonaccolto , Philipp Kremer , Sandra Paterlini , Małgorzata Bogdan , Jonas Wallin

We consider the solution of saddle-point systems with a tree-based block structure, introducing a parallelizable direct method for their solution. As our key contribution, we then propose several structure-exploiting preconditioners to be…

Numerical Analysis · Mathematics 2024-11-01 Christoph Hansknecht , Bernhard Heinzelreiter , John W. Pearson , Andreas Potschka

In this work, we consider solving optimization problems with a stochastic objective and deterministic equality constraints. We propose a Trust-Region Sequential Quadratic Programming method to find both first- and second-order stationary…

Optimization and Control · Mathematics 2024-09-27 Yuchen Fang , Sen Na , Michael W. Mahoney , Mladen Kolar

Structured prediction requires searching over a combinatorial number of structures. To tackle it, we introduce SparseMAP: a new method for sparse structured inference, and its natural loss function. SparseMAP automatically selects only a…

Machine Learning · Statistics 2018-06-21 Vlad Niculae , André F. T. Martins , Mathieu Blondel , Claire Cardie

Motivated by recent progress on stochastic matching with few queries, we embark on a systematic study of the sparsification of stochastic packing problems (SPP) more generally. Specifically, we consider SPPs where elements are independently…

Data Structures and Algorithms · Computer Science 2022-11-16 Shaddin Dughmi , Yusuf Hakan Kalayci , Neel Patel

We consider the solution of linear systems with tensor product structure using a GMRES algorithm. In order to cope with the computational complexity in large dimension both in terms of floating point operations and memory requirement, our…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-27 Olivier Coulaud , Luc Giraud , Martina Iannacito

Deep ensembles have emerged as a powerful technique for improving predictive performance and enhancing model robustness across various applications by leveraging model diversity. However, traditional deep ensemble methods are often…

We introduce the Structured Sparsity Specification (S$^3$), an algebraic framework for defining, composing, and implementing structured sparse patterns. S$^3$ specifies sparsity through three components: a View that reshapes the tensor via…

Machine Learning · Computer Science 2026-04-14 Ayoub Ghriss

A posteriori error estimates are derived in the context of two-dimensional structural elastic shape optimization under the compliance objective. It is known that the optimal shape features are microstructures that can be constructed using…

Numerical Analysis · Mathematics 2015-01-30 Benedict Geihe , Martin Rumpf

The Bayesian approach has proved to be a coherent approach to handle ill posed Inverse problems. However, the Bayesian calculations need either an optimization or an integral calculation. The maximum a posteriori (MAP) estimation requires…

Data Analysis, Statistics and Probability · Physics 2007-05-23 A. Mohammad-Djafari

In recent times, the construction of deterministic matrices has gained popularity as an alternative of random matrices as they provide guarantees for recovery of sparse signals. In particular, the construction of binary matrices has…

Combinatorics · Mathematics 2019-07-18 Pradip Sasmal , Phanindra Jampana , C. S. Sastry

While reduced-order models (ROMs) have been popular for efficiently solving large systems of differential equations, the stability of reduced models over long-time integration is of present challenges. We present a greedy approach for ROM…

Numerical Analysis · Mathematics 2018-03-20 Babak Maboudi Afkham , Jan S. Hesthaven

In this paper we discuss an application of Stochastic Approximation to statistical estimation of high-dimensional sparse parameters. The proposed solution reduces to resolving a penalized stochastic optimization problem on each stage of a…

Machine Learning · Statistics 2022-10-25 Sasila Ilandarideva , Yannis Bekri , Anatoli Juditsky , Vianney Perchet

The paper is directly motivated by the pricing of vulnerable European and American options in a general hazard process setup and a related study of the corresponding pre-default backward stochastic differential equations (BSDE) and…

Probability · Mathematics 2022-12-27 Libo Li , Ruyi Liu , Marek Rutkowski

Sparse regression codes (SPARC) connect the sparse signal recovery framework of compressive sensing with error control coding techniques. SPARC encoding produces codewords which are \emph{sparse} linear combinations of columns of a…

Information Theory · Computer Science 2023-03-27 Madhusudan Kumar Sinha , Arun Pachai Kannu

We define and discuss the first sparse coding algorithm based on closed-form EM updates and continuous latent variables. The underlying generative model consists of a standard `spike-and-slab' prior and a Gaussian noise model. Closed-form…

Machine Learning · Statistics 2012-03-05 Jörg Lücke , Abdul-Saboor Sheikh

Compressive sensing (CS) exploits sparsity to recover sparse or compressible signals from dimensionality reducing, non-adaptive sensing mechanisms. Sparsity is also used to enhance interpretability in machine learning and statistics…

Information Theory · Computer Science 2015-07-21 Anastasios Kyrillidis , Luca Baldassarre , Marwa El-Halabi , Quoc Tran-Dinh , Volkan Cevher

Bootstrap embedding (BE) is a recently developed electronic structure method that has shown great success at treating electron correlation in molecules. Here, we extend BE to treat surfaces and solids where the wave function is represented…

Strongly Correlated Electrons · Physics 2023-01-18 Oinam Romesh Meitei , Troy Van Voorhis

In this work, we study the asymptotic randomness of an algorithmic estimator of the saddle point of a globally convex-concave and locally strongly-convex strongly-concave objective. Specifically, we show that the averaged iterates of a…

Optimization and Control · Mathematics 2023-11-07 Abhishek Roy , Yi-An Ma

The horseshoe prior is known to possess many desirable properties for Bayesian estimation of sparse parameter vectors, yet its density function lacks an analytic form. As such, it is challenging to find a closed-form solution for the…

Machine Learning · Statistics 2022-11-08 Shu Yu Tew , Daniel F. Schmidt , Enes Makalic