English
Related papers

Related papers: Efficient atom selection strategy for iterative sp…

200 papers

Sparse decision trees are one of the most common forms of interpretable models. While recent advances have produced algorithms that fully optimize sparse decision trees for prediction, that work does not address policy design, because the…

Machine Learning · Computer Science 2022-10-27 Ali Behrouz , Mathias Lecuyer , Cynthia Rudin , Margo Seltzer

Portfolio optimization involves selecting asset weights to minimize a risk-reward objective, such as the portfolio variance in the classical minimum-variance framework. Sparse portfolio selection extends this by imposing a cardinality…

Machine Learning · Statistics 2025-05-16 Sarat Moka , Matias Quiroz , Vali Asimit , Samuel Muller

In this work we suggest a statistical mechanics approach to the classification of high-dimensional data according to a binary label. We propose an algorithm whose aim is twofold: First it learns a classifier from a relatively small number…

Statistical Mechanics · Physics 2009-07-22 Andrea Pagnani , Francesca Tria , Martin Weigt

Let $x\in\mathbb{C}^n$ be a spectrally sparse signal consisting of $r$ complex sinusoids with or without damping. We consider the spectral compressed sensing problem, which is about reconstructing $x$ from its partial revealed entries. By…

Optimization and Control · Mathematics 2017-08-01 Jian-Feng Cai , Tianming Wang , Ke Wei

Surrogate models are used to alleviate the computational burden in engineering tasks, which require the repeated evaluation of computationally demanding models of physical systems, such as the efficient propagation of uncertainties. For…

Machine Learning · Statistics 2022-09-28 Felix Schneider , Iason Papaioannou , Gerhard Müller

Estimating the number of eigenvalues located in a given interval of a large sparse Hermitian matrix is an important problem in certain applications and it is a prerequisite of eigensolvers based on a divide-and-conquer paradigm. Often an…

Numerical Analysis · Computer Science 2014-08-06 Edoardo Di Napoli , Eric Polizzi , Yousef Saad

The popular Lasso approach for sparse estimation can be derived via marginalization of a joint density associated with a particular stochastic model. A different marginalization of the same probabilistic model leads to a different…

Machine Learning · Statistics 2013-02-28 Aleksandr Y. Aravkin , James V. Burke , Alessandro Chiuso , Gianluigi Pillonetto

We study the problem of parameter estimation for a univariate discretely observed ergodic diffusion process given as a solution to a stochastic differential equation. The estimation procedure we propose consists of two steps. In the first…

Statistics Theory · Mathematics 2018-04-17 Shota Gugushvili , Peter Spreij

This paper addresses the issue of building a part-based representation of a dataset of images. More precisely, we look for a non-negative, sparse decomposition of the images on a reduced set of atoms, in order to unveil a morphological and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Bastien Ponchon , Santiago Velasco-Forero , Samy Blusseau , Jesus Angulo , Isabelle Bloch

We consider constrained optimization problems with a nonsmooth objective function in the form of mathematical expectation. The Sample Average Approximation (SAA) is used to estimate the objective function and variable sample size strategy…

Optimization and Control · Mathematics 2022-08-09 Natasa Krejic , Natasa Krklec Jerinkic , Tijana Ostojic

We propose a physical scheme for implementing the Deutsch-Jozsa algorithm using atomic ensembles and optical devices. The scheme has inherent fault tolerance to the realistic noise and efficient scaling with the number of ensembles for some…

Quantum Physics · Physics 2007-05-23 Ping Dong , Zheng-Yuan Xue , Ming Yang , Zhuo-Liang Cao

This work provides a new multinomial resampling procedure for particle filter resampling, focused on the case where the number of samples required is less than or equal to the size of the underlying discrete distribution. This setting is…

Data Structures and Algorithms · Computer Science 2026-04-03 Andrey A. Popov

Electron ptychography provides new opportunities to resolve atomic structures with deep sub-angstrom spatial resolution and studying electron-beam sensitive materials with high dose efficiency. In practice, obtaining accurate ptychography…

Materials Science · Physics 2022-04-26 Michael C. Cao , Zhen Chen , Yi Jiang , Yimo Han

Iterative phase retrieval algorithms typically employ projections onto constraint subspaces to recover the unknown phases in the Fourier transform of an image, or, in the case of x-ray crystallography, the electron density of a molecule.…

Numerical Analysis · Mathematics 2025-10-20 Veit Elser

Ordinary differential equations (ODEs) are widely used to characterize the dynamics of complex systems in real applications. In this article, we propose a novel joint estimation approach for generalized sparse additive ODEs where…

Methodology · Statistics 2022-08-19 Nan Zhang , Muye Nanshan , Jiguo Cao

Machine learning of atomic-scale properties is revolutionizing molecular modelling, making it possible to evaluate inter-atomic potentials with first-principles accuracy, at a fraction of the costs. The accuracy, speed and reliability of…

Computational Physics · Physics 2018-10-16 Giulio Imbalzano , Andrea Anelli , Daniele Giofr é , Sinja Klees , J örg Behler , Michele Ceriotti

This paper addresses the problem of identifying a lower dimensional space where observed data can be sparsely represented. This under-complete dictionary learning task can be formulated as a blind separation problem of sparse sources…

Methodology · Statistics 2010-08-30 Nicolas Dobigeon , Jean-Yves Tourneret

Convolutional sparse representation (CSR), shift-invariant model for inverse problems, has gained much attention in the fields of signal/image processing, machine learning and computer vision. The most challenging problems in CSR implies…

Machine Learning · Computer Science 2020-11-23 Gustavo Silva , Paul Rodriguez

We derive a stochastic gradient algorithm for semidefinite optimization using randomization techniques. The algorithm uses subsampling to reduce the computational cost of each iteration and the subsampling ratio explicitly controls…

Optimization and Control · Mathematics 2011-08-30 Alexandre d'Aspremont

In this paper, we combine the operator splitting methodology for abstract evolution equations with that of stochastic methods for large-scale optimization problems. The combination results in a randomized splitting scheme, which in a given…

Numerical Analysis · Mathematics 2022-10-12 Monika Eisenmann , Tony Stillfjord