English
Related papers

Related papers: Learning and Inference in Sparse Coding Models wit…

200 papers

Learning world models from their sensory inputs enables agents to plan for actions by imagining their future outcomes. World models have previously been shown to improve sample-efficiency in simulated environments with few objects, but have…

Machine Learning · Computer Science 2022-10-24 Arnav Kumar Jain , Shivakanth Sujit , Shruti Joshi , Vincent Michalski , Danijar Hafner , Samira Ebrahimi-Kahou

Latent variable models are widely used in social and behavioural sciences, including education, psychology, and political science. With the increasing availability of large and complex datasets, high-dimensional latent variable models have…

Computation · Statistics 2025-12-09 Motonori Oka , Yunxiao Chen , Irini Moustaki

Sparse inversion and classification problems are ubiquitous in modern data science and imaging. They are often formulated as non-smooth minimisation problems. In sparse inversion, we minimise, e.g., the sum of a data fidelity term and an…

Numerical Analysis · Mathematics 2022-11-23 Jonas Latz

Adaptive or dynamic signal sampling in sensing systems can adapt subsequent sampling strategies based on acquired signals, thereby potentially improving image quality and speed. This paper proposes a Bayesian method for adaptive sampling…

Signal Processing · Electrical Eng. & Systems 2023-02-28 Guanhua Wang , Douglas C. Noll , Jeffrey A. Fessler

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

This paper addresses identification of sparse linear and noise-driven continuous-time state-space systems, i.e., the right-hand sides in the dynamical equations depend only on a subset of the states. The key assumption in this study, is…

Systems and Control · Computer Science 2018-04-18 Zuogong Yue , Johan Thunberg , Lennart Ljung , Jorge Goncalves

State-of-the-art methods for Convolutional Sparse Coding usually employ Fourier-domain solvers in order to speed up the convolution operators. However, this approach is not without shortcomings. For example, Fourier-domain representations…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Jinhui Xiong , Peter Richtárik , Wolfgang Heidrich

It is now well established that sparse signal models are well suited to restoration tasks and can effectively be learned from audio, image, and video data. Recent research has been aimed at learning discriminative sparse models instead of…

Computer Vision and Pattern Recognition · Computer Science 2009-09-29 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro , Andrew Zisserman

We consider the problem of parameter estimation using weakly supervised datasets, where a training sample consists of the input and a partially specified annotation, which we refer to as the output. The missing information in the annotation…

Machine Learning · Computer Science 2012-06-22 M. Pawan Kumar , Ben Packer , Daphne Koller

This paper introduces an alternative approach to sampling from autoregressive models. Autoregressive models are typically sampled sequentially, according to the transition dynamics defined by the model. Instead, we propose a sampling…

Machine Learning · Computer Science 2021-12-20 Vivek Jayaram , John Thickstun

In this paper we propose a new approach for sampling from probability measures in, possibly, high dimensional spaces. By perturbing the standard overdamped Langevin dynamics by a suitable Stratonovich perturbation that preserves the…

Numerical Analysis · Mathematics 2019-04-23 Assyr Abdulle , Grigorios A. Pavliotis , Gilles Vilmart

We introduce a new method to accurately and efficiently estimate the effective dynamics of collective variables in molecular simulations. Such reduced dynamics play an essential role in the study of a broad class of processes, ranging from…

Statistical Mechanics · Physics 2022-03-28 Hadrien Vroylandt , Ludovic Goudenège , Pierre Monmarché , Fabio Pietrucci , Benjamin Rotenberg

Low complexity of a system model is essential for its use in real-time applications. However, sparse identification methods commonly have stringent requirements that exclude them from being applied in an industrial setting. In this paper,…

Systems and Control · Electrical Eng. & Systems 2022-03-24 Mark Haring , Esten Ingar Grøtli , Signe Riemer-Sørensen , Katrine Seel , Kristian Gaustad Hanssen

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

Sparse functional/longitudinal data have attracted widespread interest due to the prevalence of such data in social and life sciences. A prominent scenario where such data are routinely encountered are accelerated longitudinal studies,…

Methodology · Statistics 2024-06-24 Yidong Zhou , Hans-Georg Müller

We propose a non-linear, Bayesian non-parametric latent variable model where the latent space is assumed to be sparse and infinite dimensional a priori using an Indian buffet process prior. A posteriori, the number of instantiated…

Machine Learning · Statistics 2022-05-30 Michael Minyi Zhang

Real-world processes often contain intermediate state that can be modeled as an extremely sparse activation tensor. In this work, we analyze the identifiability of such sparse and local latent intermediate variables, which we call motifs.…

Machine Learning · Computer Science 2026-03-04 Kavi Gupta , Osbert Bastani , Armando Solar-Lezama

We describe a simple stochastic method, so-called Langevin approach, which enables one to extract evolution equations of stochastic variables from a set of measurements. Our method is parameter-free and it is based on the nonlinear Langevin…

Data Analysis, Statistics and Probability · Physics 2015-02-19 Nico Reinke , André Fuchs , Wided Medjroubi , Pedro G. Lind , Matthias Wächter , Joachim Peinke

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-10-11 Vardan Papyan , Jeremias Sulam , Michael Elad

Discrete-time linear time-varying (LTV) systems form a powerful class of models to approximate complex dynamical systems with nonlinear dynamics for the purpose of analysis, design and control. Motivated by inference of spatio-temporal…

Systems and Control · Computer Science 2018-05-23 Roel Dobbe , Stephan Liu , Ye Yuan , Claire Tomlin