English
Related papers

Related papers: Autoencoders with Intrinsic Dimension Constraints …

200 papers

Regularized training of an autoencoder typically results in hidden unit biases that take on large negative values. We show that negative biases are a natural result of using a hidden layer whose responsibility is to both represent the input…

Machine Learning · Statistics 2015-04-09 Kishore Konda , Roland Memisevic , David Krueger

Deep neural networks (DNNs) trained for image denoising are able to generate high-quality samples with score-based reverse diffusion algorithms. These impressive capabilities seem to imply an escape from the curse of dimensionality, but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Zahra Kadkhodaie , Florentin Guth , Eero P. Simoncelli , Stéphane Mallat

Variational methods are widely applied to ill-posed inverse problems for they have the ability to embed prior knowledge about the solution. However, the level of performance of these methods significantly depends on a set of parameters,…

Optimization and Control · Mathematics 2020-01-23 Carla Bertocchi , Emilie Chouzenoux , Marie-Caroline Corbineau , Jean-Christophe Pesquet , Marco Prato

Limited-angle X-ray tomography reconstruction is an ill-conditioned inverse problem in general. Especially when the projection angles are limited and the measurements are taken in a photon-limited condition, reconstructions from classical…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Zhen Guo , Jung Ki Song , George Barbastathis , Michael E. Glinsky , Courtenay T. Vaughan , Kurt W. Larson , Bradley K. Alpert , Zachary H. Levine

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinyi Yu , Liqin Lu , Jintao Rong , Guangkai Xu , Linlin Ou

Data reconstruction attacks on trained neural networks aim to recover the data on which the network has been trained and pose a significant threat to privacy, especially if the training dataset contains sensitive information. Here, we…

Machine Learning · Computer Science 2026-05-08 Edward Tansley , Roy Makhlouf , Estelle Massart , Coralia Cartis

Masked Image Modeling (MIM) achieves outstanding success in self-supervised representation learning. Unfortunately, MIM models typically have huge computational burden and slow learning process, which is an inevitable obstacle for their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Haoqing Wang , Yehui Tang , Yunhe Wang , Jianyuan Guo , Zhi-Hong Deng , Kai Han

Automatic 3D neuron reconstruction is critical for analysing the morphology and functionality of neurons in brain circuit activities. However, the performance of existing tracing algorithms is hinged by the low image quality. Recently, a…

Image and Video Processing · Electrical Eng. & Systems 2021-09-17 Heng Wang , Chaoyi Zhang , Jianhui Yu , Yang Song , Siqi Liu , Wojciech Chrzanowski , Weidong Cai

Super-resolution reconstruction techniques entail the utilization of software algorithms to transform one or more sets of low-resolution images captured from the same scene into high-resolution images. In recent years, considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Hao Yan , Zixiang Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu , Ranran Lyu

Autoencoders are neural network formulations where the input and output of the network are identical and the goal is to identify the hidden representation in the provided datasets. Generally, autoencoders project the data nonlinearly onto a…

Signal Processing · Electrical Eng. & Systems 2019-07-10 Debjani Bhowick , Deepak K. Gupta , Saumen Maiti , Uma Shankar

Detecting out-of-distribution (OOD) samples is crucial to the safe deployment of a classifier in the real world. However, deep neural networks are known to be overconfident for abnormal data. Existing works directly design score function by…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Wenyu Jiang , Yuxin Ge , Hao Cheng , Mingcai Chen , Shuai Feng , Chongjun Wang

Data generated by edge devices has the potential to train intelligent autonomous systems across various domains. Despite the emergence of diverse machine learning approaches addressing privacy concerns and utilizing distributed data,…

Machine Learning · Computer Science 2024-03-12 Adarsh N L , Arun P , Alok Porwal , Malcolm Aranha

Regularization strategies in medical image registration often take a one-size-fits-all approach by imposing uniform constraints across the entire image domain. Yet biological structures are anything but regular. Lacking structural…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Ziad Kheil , Soleakhena Ken , Laurent Risser

Reliably detecting anomalies in a given set of images is a task of high practical relevance for visual quality inspection, surveillance, or medical image analysis. Autoencoder neural networks learn to reconstruct normal images, and hence…

Machine Learning · Computer Science 2019-01-21 Laura Beggel , Michael Pfeiffer , Bernd Bischl

We present a new latent model of natural images that can be learned on large-scale datasets. The learning process provides a latent embedding for every image in the training dataset, as well as a deep convolutional network that maps the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 ShahRukh Athar , Evgeny Burnaev , Victor Lempitsky

Recent medical image reconstruction techniques focus on generating high-quality medical images suitable for clinical use at the lowest possible cost and with the fewest possible adverse effects on patients. Recent works have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Shijun Liang , Anish Lahiri , Saiprasad Ravishankar

In this work we test the ability of deep learning methods to provide an end-to-end mapping between low and high resolution images applying it to the iris recognition problem. Here, we propose the use of two deep learning single-image…

Image and Video Processing · Electrical Eng. & Systems 2023-11-03 Eduardo Ribeiro , Andreas Uhl , Fernando Alonso-Fernandez , Reuben A. Farrugia

Autoencoders have been extensively used in the development of recent anomaly detection techniques. The premise of their application is based on the notion that after training the autoencoder on normal training data, anomalous inputs will…

Machine Learning · Computer Science 2024-03-29 Amin Ghafourian , Huanyi Shui , Devesh Upadhyay , Rajesh Gupta , Dimitar Filev , Iman Soltani Bozchalooi

Autoencoding, which aims to reconstruct the input images through a bottleneck latent representation, is one of the classic feature representation learning strategies. It has been shown effective as an auxiliary task for semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yuhao Lin , Haiming Xu , Lingqiao Liu , Jinan Zou , Javen Qinfeng Shi

Learning-based 3D reconstruction methods have shown impressive results. However, most methods require 3D supervision which is often hard to obtain for real-world datasets. Recently, several works have proposed differentiable rendering…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Michael Niemeyer , Lars Mescheder , Michael Oechsle , Andreas Geiger