English
Related papers

Related papers: Learning Generative Prior with Latent Space Sparsi…

200 papers

Deep latent generative models have attracted increasing attention due to the capacity of combining the strengths of deep learning and probabilistic models in an elegant way. The data representations learned with the models are often…

Machine Learning · Computer Science 2023-04-04 Zhao Xu , Daniel Onoro Rubio , Giuseppe Serra , Mathias Niepert

Deep generative modeling has led to new and state of the art approaches for enforcing structural priors in a variety of inverse problems. In contrast to priors given by sparsity, deep models can provide direct low-dimensional…

Optimization and Control · Mathematics 2018-12-12 Wen Huang , Paul Hand , Reinhard Heckel , Vladislav Voroninski

Deep learning models have significantly improved the visual quality and accuracy on compressive sensing recovery. In this paper, we propose an algorithm for signal reconstruction from compressed measurements with image priors captured by a…

Machine Learning · Computer Science 2020-03-20 Shaojie Xu , Sihan Zeng , Justin Romberg

Large language models deliver strong generative performance but at the cost of massive parameter counts, memory use, and decoding latency. Prior work has shown that pruning and structured sparsity can preserve accuracy under substantial…

Computation and Language · Computer Science 2026-04-17 Andrew Kiruluta

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent)…

Machine Learning · Computer Science 2025-04-22 Dimitris G. Giovanis , Ellis Crabtree , Roger G. Ghanem , Ioannis G. Kevrekidis

Sparsity is a desirable attribute. It can lead to more efficient and more effective representations compared to the dense model. Meanwhile, learning sparse latent representations has been a challenging problem in the field of computer…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Hanao Li , Tian Han

The goal of compressed sensing is to learn a structured signal $x$ from a limited number of noisy linear measurements $y \approx Ax$. In traditional compressed sensing, "structure" is represented by sparsity in some known basis. Inspired by…

Data Structures and Algorithms · Computer Science 2019-12-09 Akshay Kamath , Sushrut Karmalkar , Eric Price

In compressed sensing, a small number of linear measurements can be used to reconstruct an unknown signal. Existing approaches leverage assumptions on the structure of these signals, such as sparsity or the availability of a generative…

Machine Learning · Statistics 2018-08-02 Manik Dhar , Aditya Grover , Stefano Ermon

Deep compressed sensing assumes the data has sparse representation in a latent space, i.e., it is intrinsically of low-dimension. The original data is assumed to be mapped from a low-dimensional space through a low-to-high-dimensional…

Image and Video Processing · Electrical Eng. & Systems 2021-06-22 Ashkan Esmaeili

Deep neural networks (DNNs) have been quite successful in solving many complex learning problems. However, DNNs tend to have a large number of learning parameters, leading to a large memory and computation requirement. In this paper, we…

Machine Learning · Computer Science 2019-05-21 Sangkyun Lee , Jeonghyun Lee

When deploying deep learning models to a device, it is traditionally assumed that available computational resources (compute, memory, and power) remain static. However, real-world computing systems do not always provide stable resource…

Machine Learning · Computer Science 2021-10-11 Elvis Nunez , Maxwell Horton , Anish Prabhu , Anurag Ranjan , Ali Farhadi , Mohammad Rastegari

Compressed sensing (CS) provides an elegant framework for recovering sparse signals from compressed measurements. For example, CS can exploit the structure of natural images and recover an image from only a few random measurements. CS is…

Machine Learning · Computer Science 2019-05-21 Yan Wu , Mihaela Rosca , Timothy Lillicrap

We propose a novel method for compressed sensing recovery using untrained deep generative models. Our method is based on the recently proposed Deep Image Prior (DIP), wherein the convolutional weights of the network are optimized to match…

In this study we develop dimension-reduction techniques to accelerate diffusion model inference in the context of synthetic data generation. The idea is to integrate compressed sensing into diffusion models (hence, CSDM): First, compress…

Machine Learning · Statistics 2025-09-30 Zhengyi Guo , Jiatu Li , Wenpin Tang , David D. Yao

Snapshot compressive spectral imaging reconstruction aims to reconstruct three-dimensional spatial-spectral images from a single-shot two-dimensional compressed measurement. Existing state-of-the-art methods are mostly based on deep…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Zongliang Wu , Ruiying Lu , Ying Fu , Xin Yuan

Modeling the time-dependent evolution of electron density is essential for understanding quantum mechanical behaviors of condensed matter and enabling predictive simulations in spectroscopy, photochemistry, and ultrafast science. Yet, while…

Computational Physics · Physics 2025-09-03 Yuan Chiang , Youngsoo Choi , Daniel Osei-Kuffuor

Deep generative models have emerged as a powerful class of priors for signals in various inverse problems such as compressed sensing, phase retrieval and super-resolution. Here, we assume an unknown signal to lie in the range of some…

Machine Learning · Statistics 2021-02-26 Thanh V. Nguyen , Gauri Jagatap , Chinmay Hegde

We develop a new framework for learning variational autoencoders and other deep generative models that balances generative and discriminative goals. Our framework optimizes model parameters to maximize a variational lower bound on the…

Machine Learning · Computer Science 2020-12-15 Gabriel Hope , Madina Abdrakhmanova , Xiaoyin Chen , Michael C. Hughes , Michael C. Hughes , Erik B. Sudderth

A pre-trained generator has been frequently adopted in compressed sensing (CS) due to its ability to effectively estimate signals with the prior of NNs. In order to further refine the NN-based prior, we propose a framework that allows the…

Machine Learning · Computer Science 2020-11-03 Kyung-Su Kim , Jung Hyun Lee , Eunho Yang

Recent work in Deep Learning has re-imagined the representation of data as functions mapping from a coordinate space to an underlying continuous signal. When such functions are approximated by neural networks this introduces a compelling…

Machine Learning · Statistics 2022-08-09 Jonathan Richard Schwarz , Yee Whye Teh
‹ Prev 1 2 3 10 Next ›