English
Related papers

Related papers: Generating Sparse Stochastic Processes Using Match…

200 papers

We establish the first existence and uniqueness result for mild solutions of abstract stochastic evolution equations driven by arbitrary cylindrical L\'evy processes in Hilbert spaces. The coefficients are assumed to satisfy global…

Probability · Mathematics 2026-05-14 Gergely Bodó , Sonja Cox , Adam Jakubowski , Markus Riedle

This paper presents a new variable selection approach integrated with Gaussian process (GP) regression. We consider a sparse projection of input variables and a general stationary covariance model that depends on the Euclidean distance…

Machine Learning · Computer Science 2020-08-26 Chiwoo Park , David J. Borth , Nicholas S. Wilson , Chad N. Hunter

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

We present a new deep learning paradigm for the generation of sparse approximate inverse (SPAI) preconditioners for matrix systems arising from the mesh-based discretization of elliptic differential operators. Our approach is based upon the…

Machine Learning · Computer Science 2024-05-21 Mou Li , He Wang , Peter K. Jimack

We present a method for fitting monotone curves using cubic B-splines, which is equivalent to putting a monotonicity constraint on the coefficients. We explore different ways of enforcing this constraint and analyze their theoretical and…

Methodology · Statistics 2023-11-20 Lijun Wang , Xiaodan Fan , Huabai Li , Jun S. Liu

A stochastic algorithm is proposed, finding the set of generalized means associated to a probability measure on a compact Riemannian manifold M and a continuous cost function on the product of M by itself. Generalized means include p-means…

Probability · Mathematics 2013-05-28 Marc Arnaudon , Laurent Miclo

We introduce a scalable approach to Gaussian process inference that combines spatio-temporal filtering with natural gradient variational inference, resulting in a non-conjugate GP method for multivariate data that scales linearly with…

Machine Learning · Computer Science 2021-11-03 Oliver Hamelijnck , William J. Wilkinson , Niki A. Loppi , Arno Solin , Theodoros Damoulas

This paper proposes a sparse regression strategy for discovery of ordinary differential equations from incomplete and noisy data. Inference is performed over both equation parameters and state variables using a statistically motivated…

Dynamical Systems · Mathematics 2026-02-18 Teddy Meissner , Karl Glasner

We consider the problem of estimating a deterministic sparse vector x from underdetermined measurements Ax+w, where w represents white Gaussian noise and A is a given deterministic dictionary. We analyze the performance of three sparse…

Statistics Theory · Mathematics 2015-05-13 Zvika Ben-Haim , Yonina C. Eldar , Michael Elad

It is a survey on recent results in constructive sparse approximation. Three directions are discussed here: (1) Lebesgue-type inequalities for greedy algorithms with respect to a special class of dictionaries, (2) constructive sparse…

Numerical Analysis · Mathematics 2015-11-06 Vladimir Temlyakov

In this paper we propose an identification procedure of a sparse graphical model associated to a Gaussian stationary stochastic process. The identification paradigm exploits the approximation of autoregressive processes through reciprocal…

Optimization and Control · Mathematics 2018-06-13 Daniele Alpago , Mattia Zorzi , Augusto Ferrante

Among generalized additive models, additive Mat\'ern Gaussian Processes (GPs) are one of the most popular for scalable high-dimensional problems. Thanks to their additive structure and stochastic differential equation representation,…

Machine Learning · Statistics 2023-05-02 Lu Zou , Haoyuan Chen , Liang Ding

It has recently been shown that many of the existing quasi-Newton algorithms can be formulated as learning algorithms, capable of learning local models of the cost functions. Importantly, this understanding allows us to safely start…

Machine Learning · Statistics 2017-04-06 Adrian G. Wills , Thomas B. Schön

We propose an algorithm to approximate solutions of global optimization problems in Sobolev spaces that follows the spirit of Consensus-based algorithms in finite dimensions. The main ingredient are Gaussian processes. In fact, we exploit…

Optimization and Control · Mathematics 2026-03-17 Mahmoud Khatab , Claudia Totzeck

Analogue to the well-known Langevin Monte Carlo method, in this article we provide a method to sample from a target distribution \(\pi\) by simulating a solution of a stochastic differential equation. Hereby, the stochastic differential…

Probability · Mathematics 2023-03-15 David Oechsler

In this document, we present key findings in structured matrix approximation theory, with applications to the regressive representation of dynamic financial processes. Initially, we explore a comprehensive approach involving generic…

Systems and Control · Electrical Eng. & Systems 2025-10-28 Fredy Vides , Idelfonso B. R. Nogueira , Gabriela Lopez Gutierrez , Lendy Banegas , Evelyn Flores

Semilinear hyperbolic stochastic partial differential equations (SPDEs) find widespread applications in the natural and engineering sciences. However, the traditional Gaussian setting may prove too restrictive, as phenomena in mathematical…

Numerical Analysis · Mathematics 2023-07-04 Andrea Barth , Andreas Stein

We consider the problem of estimating unknown parameters in stochastic differential equations driven by colored noise, which we model as a sequence of Gaussian stationary processes with decreasing correlation time. We aim to infer…

Numerical Analysis · Mathematics 2024-12-30 Grigorios A. Pavliotis , Sebastian Reich , Andrea Zanoni

In this work we introduce a novel stochastic algorithm dubbed SNIPS, which draws samples from the posterior distribution of any linear inverse problem, where the observation is assumed to be contaminated by additive white Gaussian noise.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-11 Bahjat Kawar , Gregory Vaksman , Michael Elad

We consider a hidden Markov model, where the signal process, given by a diffusion, is only indirectly observed through some noisy measurements. The article develops a variational method for approximating the hidden states of the signal…

Optimization and Control · Mathematics 2016-10-26 Tobias Sutter , Arnab Ganguly , Heinz Koeppl