English
Related papers

Related papers: Mapping prior information onto LMI eigenvalue-regi…

200 papers

Deep latent variable models learn condensed representations of data that, hopefully, reflect the inner workings of the studied phenomena. Unfortunately, these latent representations are not statistically identifiable, meaning they cannot be…

Machine Learning · Statistics 2025-06-02 Stas Syrota , Yevgen Zainchkovskyy , Johnny Xi , Benjamin Bloem-Reddy , Søren Hauberg

We perform approximate inference in state-space models with nonlinear state transitions. Without parameterizing a generative model, we apply Bayesian update formulas using a local linearity approximation parameterized by neural networks.…

Machine Learning · Computer Science 2022-01-26 David Ruhe , Patrick Forré

Learned video compression methods have gained a variety of interest in the video coding community since they have matched or even exceeded the rate-distortion (RD) performance of traditional video codecs. However, many current…

Image and Video Processing · Electrical Eng. & Systems 2024-02-02 Huairui Wang , Zhenzhong Chen

Data privacy and decentralised data collection has become more and more popular in recent years. In order to solve issues with privacy, communication bandwidth and learning from spatio-temporal data, we will propose two efficient models…

Machine Learning · Computer Science 2023-01-19 Timon Sachweh , Daniel Boiar , Thomas Liebig

High-dimensional observations are a major challenge in the application of model-based reinforcement learning (MBRL) to real-world environments. To handle high-dimensional sensory inputs, existing approaches use representation learning to…

Machine Learning · Computer Science 2021-06-15 Tung Nguyen , Rui Shu , Tuan Pham , Hung Bui , Stefano Ermon

The knowledge that humans hold about a problem often extends far beyond a set of training data and output labels. While the success of deep learning mostly relies on supervised training, important properties cannot be inferred efficiently…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Damien Teney , Ehsan Abbasnejad , Anton van den Hengel

For several styles of fidelity constraints -- guaranteed distortion, conditional excess distortion, excess distortion -- we show mutual information upper bounds on the minimum expected description length needed to represent a random…

Information Theory · Computer Science 2026-02-10 Victoria Kostina

The ability of deep image prior (DIP) to recover high-quality images from incomplete or corrupted measurements has made it popular in inverse problems in image restoration and medical imaging including magnetic resonance imaging (MRI).…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Shijun Liang , Evan Bell , Qing Qu , Rongrong Wang , Saiprasad Ravishankar

Through the use of carefully tailored convolutional neural network architectures, a deep image prior (DIP) can be used to obtain pre-images from latent representation encodings. Though DIP inversion has been known to be superior to…

Machine Learning · Computer Science 2020-10-26 Vivek Narayanaswamy , Jayaraman J. Thiagarajan , Andreas Spanias

This work proposes a discretization of the acoustic wave equation with possibly oscillatory coefficients based on a superposition of discrete solutions to spatially localized subproblems computed with an implicit time discretization. Based…

Numerical Analysis · Mathematics 2024-03-11 Dietmar Gallistl , Roland Maier

We present new differentially private algorithms for learning a large-margin halfspace. In contrast to previous algorithms, which are based on either differentially private simulations of the statistical query model or on private convex…

Machine Learning · Computer Science 2020-02-25 Huy L. Nguyen , Jonathan Ullman , Lydia Zakynthinou

We address the problem of compressed sensing (CS) with prior information: reconstruct a target CS signal with the aid of a similar signal that is known beforehand, our prior information. We integrate the additional knowledge of the similar…

Information Theory · Computer Science 2014-08-25 Joao F. C. Mota , Nikos Deligiannis , Miguel R. D. Rodrigues

Recent contrastive representation learning methods rely on estimating mutual information (MI) between multiple views of an underlying context. E.g., we can derive multiple views of a given image by applying data augmentation, or we can…

Machine Learning · Computer Science 2021-06-28 Alessandro Sordoni , Nouha Dziri , Hannes Schulz , Geoff Gordon , Phil Bachman , Remi Tachet

The problem of low-rank matrix reconstruction arises in various applications in communications and signal processing. The state of the art research largely focuses on the recovery techniques that utilize affine maps satisfying the…

Signal Processing · Electrical Eng. & Systems 2020-04-07 Wei Zhang , Taejoon Kim , Guojun Xiong , Shu-Hung Leung

This paper puts forth a novel bi-linear modeling framework for data recovery via manifold-learning and sparse-approximation arguments and considers its application to dynamic magnetic-resonance imaging (dMRI). Each temporal-domain MR image…

Image and Video Processing · Electrical Eng. & Systems 2020-02-28 Gaurav N. Shetty , Konstantinos Slavakis , Abhishek Bose , Ukash Nakarmi , Gesualdo Scutari , Leslie Ying

We address the problem of compressed sensing with multiple measurement vectors associated with prior information in order to better reconstruct an original sparse matrix signal. $\ell_{2,1}-\ell_{2,1}$ minimization is used to emphasize…

Information Theory · Computer Science 2015-10-23 Shih-Wei Hu , Gang-Xuan Lin , Sung-Hsien Hsieh , Wei-Jie Liang , Chun-Shien Lu

With the success of self-supervised representations, researchers seek a better understanding of the information encapsulated within a representation. Among various interpretability methods, we focus on classification-based linear probing.…

Information Theory · Computer Science 2023-12-18 Kwanghee Choi , Jee-weon Jung , Shinji Watanabe

Discrete latent spaces in variational autoencoders have been shown to effectively capture the data distribution for many real-world problems such as natural language understanding, human intent prediction, and visual scene representation.…

Machine Learning · Computer Science 2021-01-19 Masha Itkina , Boris Ivanovic , Ransalu Senanayake , Mykel J. Kochenderfer , Marco Pavone

Objective: To propose and validate an unsupervised MRI reconstruction method that does not require fully sampled k-space data. Materials and Methods: The proposed method, deep image prior with structured sparsity (DISCUS), extends the deep…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Muhammad Ahmad Sultan , Chong Chen , Yingmin Liu , Katarzyna Gil , Karolina Zareba , Rizwan Ahmad

Sequential modelling of high-dimensional data is an important problem that appears in many domains including model-based reinforcement learning and dynamics identification for control. Latent variable models applied to sequential data…

Machine Learning · Computer Science 2023-01-23 Oliver Limoyo , Trevor Ablett , Jonathan Kelly