English
Related papers

Related papers: How Much Training Data is Memorized in Overparamet…

200 papers

As machine learning systems increasingly rely on data subject to privacy regulation, selectively unlearning specific information from trained models has become essential. In image classification, this involves removing the influence of…

Machine Learning · Computer Science 2025-06-18 Prabhav Sanga , Jaskaran Singh , Arun K. Dubey

Two of the main challenges of image restoration in real-world scenarios are the accurate characterization of an image prior and the precise modeling of the image degradation operator. Pre-trained diffusion models have been very successfully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Hamadi Chihaoui , Paolo Favaro

Anomaly detection is the problem of recognizing abnormal inputs based on the seen examples of normal data. Despite recent advances of deep learning in recognizing image anomalies, these methods still prove incapable of handling complex…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Nina Shvetsova , Bart Bakker , Irina Fedulova , Heinrich Schulz , Dmitry V. Dylov

Recent work in machine learning shows that deep neural networks can be used to solve a wide variety of inverse problems arising in computational imaging. We explore the central prevailing themes of this emerging area and present a taxonomy…

Image and Video Processing · Electrical Eng. & Systems 2020-05-14 Gregory Ongie , Ajil Jalal , Christopher A. Metzler , Richard G. Baraniuk , Alexandros G. Dimakis , Rebecca Willett

PET image reconstruction is challenging due to the ill-poseness of the inverse problem and limited number of detected photons. Recently deep neural networks have been widely and successfully used in computer vision tasks and attracted…

Computer Vision and Pattern Recognition · Computer Science 2017-10-11 Kuang Gong , Jiahui Guan , Kyungsang Kim , Xuezhu Zhang , Georges El Fakhri , Jinyi Qi , Quanzheng Li

In computer-aided diagnosis (CAD) focused on microscopy, denoising improves the quality of image analysis. In general, the accuracy of this process may depend both on the experience of the microscopist and on the equipment sensitivity and…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Fabio Hernán Gil Zuluaga , Francesco Bardozzo , Jorge Iván Ríos Patiño , Roberto Tagliaferri

Inverse problems arise in a variety of imaging applications including computed tomography, non-destructive testing, and remote sensing. The characteristic features of inverse problems are the non-uniqueness and instability of their…

Numerical Analysis · Mathematics 2020-06-09 Markus Haltmeier , Linh V. Nguyen

Iterative learning to infer approaches have become popular solvers for inverse problems. However, their memory requirements during training grow linearly with model depth, limiting in practice model expressiveness. In this work, we propose…

Machine Learning · Computer Science 2019-11-26 Patrick Putzky , Max Welling

Objective: This paper investigates how generative models, trained on ground-truth images, can be used \changes{as} priors for inverse problems, penalizing reconstructions far from images the generator can produce. The aim is that learned…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Margaret Duff , Ivor J. A. Simpson , Matthias J. Ehrhardt , Neill D. F. Campbell

Data preparation, i.e. the process of transforming raw data into a format that can be used for training effective machine learning models, is a tedious and time-consuming task. For image data, preprocessing typically involves a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Tran Ngoc Minh , Mathieu Sinn , Hoang Thanh Lam , Martin Wistuba

We consider ill-posed inverse problems where the forward operator $T$ is unknown, and instead we have access to training data consisting of functions $f_i$ and their noisy images $Tf_i$. This is a practically relevant and challenging…

Machine Learning · Statistics 2023-02-21 Miguel del Alamo

Renovating the memories in old photos is an intriguing research topic in computer vision fields. These legacy images often suffer from severe and commingled degradations such as cracks, noise, and color-fading, while lack of large-scale…

Image and Video Processing · Electrical Eng. & Systems 2022-05-12 Runsheng Xu , Zhengzhong Tu , Yuanqi Du , Xiaoyu Dong , Jinlong Li , Zibo Meng , Jiaqi Ma , Hongkai Yu

Deep neural networks are over-parameterized and easily overfit the datasets they train on. In the extreme case, it has been shown that these networks can memorize a training set with fully randomized labels. We propose using the curvature…

Machine Learning · Computer Science 2023-10-03 Isha Garg , Deepak Ravikumar , Kaushik Roy

Autoencoders are a type of unsupervised neural networks, which can be used to solve various tasks, e.g., dimensionality reduction, image compression, and image denoising. An AE has two goals: (i) compress the original input to a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Firas Laakom , Jenni Raitoharju , Alexandros Iosifidis , Moncef Gabbouj

We consider the unsupervised scene adaptation problem of learning from both labeled source data and unlabeled target data. Existing methods focus on minoring the inter-domain gap between the source and target domains. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Zhedong Zheng , Yi Yang

Deep neural networks usually benefit from unsupervised pre-training, e.g. auto-encoders. However, the classifier further needs supervised fine-tuning methods for good discrimination. Besides, due to the limits of full-connection, the…

Computer Vision and Pattern Recognition · Computer Science 2016-05-10 Hailin Shi , Xiangyu Zhu , Zhen Lei , Shengcai Liao , Stan Z. Li

Reconstruction error-based neural architectures constitute a classical deep learning approach to anomaly detection which has shown great performances. It consists in training an Autoencoder to reconstruct a set of examples deemed to…

Machine Learning · Computer Science 2024-06-06 Fabrizio Angiulli , Fabio Fassetti , Luca Ferragina

Magnetic Resonance Imaging can produce detailed images of the anatomy and physiology of the human body that can assist doctors in diagnosing and treating pathologies such as tumours. However, MRI suffers from very long acquisition times…

Image and Video Processing · Electrical Eng. & Systems 2022-03-30 George Yiasemis , Jan-Jakob Sonke , Clarisa Sánchez , Jonas Teuwen

Many tasks performed by autonomous vehicles such as road marking detection, object tracking, and path planning are simpler in bird's-eye view. Hence, Inverse Perspective Mapping (IPM) is often applied to remove the perspective effect from a…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Tom Bruls , Horia Porav , Lars Kunze , Paul Newman

Existing black box modeling approaches in machine learning suffer from a fixed input and output feature combination. In this paper, a new approach to reconstruct missing variables in a set of time series is presented. An autoencoder is…

Machine Learning · Computer Science 2023-08-22 Jan-Philipp Roche , Oliver Niggemann , Jens Friebe