English
Related papers

Related papers: Generalizing to Out-of-Sample Degradations via Mod…

200 papers

In this paper, we study the problem of image recovery from given partial (corrupted) observations. Recovering an image using a low-rank model has been an active research area in data analysis and machine learning. But often, images are not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Pawan Goyal , Hussam Al Daas , Peter Benner

Despite the tremendous success of deep models in various individual image restoration tasks, there are at least two major technical challenges preventing these works from being applied to real-world usages: (1) the lack of generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xiangtao Kong , Jinjin Gu , Yihao Liu , Wenlong Zhang , Xiangyu Chen , Yu Qiao , Chao Dong

Image-to-image translation is a general name for a task where an image from one domain is converted to a corresponding image in another domain, given sufficient training data. Traditionally different approaches have been proposed depending…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Soumya Tripathy , Juho Kannala , Esa Rahtu

Optical Coherence Tomography (OCT) is a widely used non-invasive biomedical imaging modality that can rapidly provide volumetric images of samples. Here, we present a deep learning-based image reconstruction framework that can generate…

Image and Video Processing · Electrical Eng. & Systems 2021-07-30 Yijie Zhang , Tairan Liu , Manmohan Singh , Yilin Luo , Yair Rivenson , Kirill V. Larin , Aydogan Ozcan

Machine unlearning is the process of removing the impact of a particular set of training samples from a pretrained model. It aims to fulfill the "right to be forgotten", which grants the individuals such as patients the right to reconsider…

Machine Learning · Computer Science 2024-07-11 Reza Nasirigerdeh , Nader Razmi , Julia A. Schnabel , Daniel Rueckert , Georgios Kaissis

Inverse problems are fundamental to science and engineering, where the goal is to infer an underlying signal or state from incomplete or noisy measurements. Recent approaches employ diffusion models as powerful implicit priors for such…

Machine Learning · Computer Science 2025-11-27 Bilal Ahmed , Joseph G. Makin

Image degradation synthesis is highly desirable in a wide variety of applications ranging from image restoration to simulating artistic effects. Existing models are designed to generate one specific or a narrow set of degradations, which…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Wenbo Yang , Zhongling Wang , Zhou Wang

The identification of states and parameters from noisy measurements of a dynamical system is of great practical significance and has received a lot of attention. Classically, this problem is expressed as optimization over a class of models.…

In scientific machine learning, regression networks have been recently applied to approximate solution maps (e.g., potential-ground state map of Schr\"odinger equation). In this paper, we aim to reduce the generalization error without…

Numerical Analysis · Mathematics 2021-02-16 Zhihan Li , Yuwei Fan , Lexing Ying

In this work, we consider methods for solving large-scale optimization problems with a possibly nonsmooth objective function. The key idea is to first specify a class of optimization algorithms using a generic iterative scheme involving…

Optimization and Control · Mathematics 2020-02-19 Sebastian Banert , Axel Ringh , Jonas Adler , Johan Karlsson , Ozan Öktem

The purpose of this paper is to report on recent approaches to reconstruction problems based on analog, or in other words, infinite-dimensional, image and signal models. We describe three main contributions to this problem. First, linear…

Numerical Analysis · Mathematics 2013-10-07 Ben Adcock , Anders Hansen , Bogdan Roman , Gerd Teschke

Given data with label noise (i.e., incorrect data), deep neural networks would gradually memorize the label noise and impair model performance. To relieve this issue, curriculum learning is proposed to improve model performance and…

Machine Learning · Computer Science 2022-08-23 Tingting Wu , Xiao Ding , Hao Zhang , Jinglong Gao , Li Du , Bing Qin , Ting Liu

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Most existing Image Restoration (IR) models are task-specific, which can not be generalized to different degradation operators. In this work, we propose the Denoising Diffusion Null-Space Model (DDNM), a novel zero-shot framework for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Yinhuai Wang , Jiwen Yu , Jian Zhang

Most of the recent few-shot learning (FSL) algorithms are based on transfer learning, where a model is pre-trained using a large amount of source data, and the pre-trained model is fine-tuned using a small amount of target data. In transfer…

Machine Learning · Computer Science 2022-08-22 Yujin Kim , Jaehoon Oh , Sungnyun Kim , Se-Young Yun

Deep Metric Learning (DML) aims to find representations suitable for zero-shot transfer to a priori unknown test distributions. However, common evaluation protocols only test a single, fixed data split in which train and test classes are…

Machine Learning · Computer Science 2021-11-30 Timo Milbich , Karsten Roth , Samarth Sinha , Ludwig Schmidt , Marzyeh Ghassemi , Björn Ommer

Out-of-distribution (OOD) generalization is a favorable yet challenging property for deep neural networks. The core challenges lie in the limited availability of source domains that help models learn an invariant representation from the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yijiang Li , Sucheng Ren , Weipeng Deng , Yuzhi Xu , Ying Gao , Edith Ngai , Haohan Wang

Bootstrap resampling is the foundation of many ensemble learning methods, and out-of-bag (OOB) error estimation is the most widely used internal measure of generalization performance. In the standard multinomial bootstrap, the number of…

Methodology · Statistics 2025-11-25 Cheng Peng

In real-world recognition/classification tasks, limited by various objective factors, it is usually difficult to collect training samples to exhaust all classes when training a recognizer or classifier. A more realistic scenario is open set…

Machine Learning · Computer Science 2020-03-24 Chuanxing Geng , Sheng-jun Huang , Songcan Chen

Modern foundation models exhibit remarkable out-of-distribution (OOD) generalization, solving tasks far beyond the support of their training data. However, the theoretical principles underpinning this phenomenon remain elusive. This paper…

Machine Learning · Statistics 2025-05-29 Jiawei Ge , Amanda Wang , Shange Tang , Chi Jin