English
Related papers

Related papers: Equivariant Test-Time Training with Operator Sketc…

200 papers

Probabilistic ideas and tools have recently begun to permeate into several fields where they had traditionally not played a major role, including fields such as numerical linear algebra and optimization. One of the key ways in which these…

Numerical Analysis · Mathematics 2016-12-20 Robert M. Gower

Standard convolutional neural networks(CNNs) require consistent image resolutions in both training and testing phase. However, in practice, testing with smaller image sizes is necessary for fast inference. We show that trivially evaluating…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Zhuoran Yu , Aojun Zhou , Yukun Ma , Yudian Li , Xiaohan Zhang , Ping Luo

Anomaly detection without priors of the anomalies is challenging. In the field of unsupervised anomaly detection, traditional auto-encoder (AE) tends to fail based on the assumption that by training only on normal images, the model will not…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Yajie Cui , Zhaoxiang Liu , Shiguo Lian

Electrical Impedance Tomography (EIT) is a non-invasive imaging technique that reconstructs conductivity distributions within a body from boundary measurements. However, EIT reconstruction is hindered by its ill-posed nonlinear inverse…

Image and Video Processing · Electrical Eng. & Systems 2024-09-11 Bowen Tong , Junwu Wang , Dong Liu

In this paper, we use deep neural networks for inverting face sketches to synthesize photorealistic face images. We first construct a semi-simulated dataset containing a very large number of computer-generated face sketches with different…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Yağmur Güçlütürk , Umut Güçlü , Rob van Lier , Marcel A. J. van Gerven

Deep generative models have emerged as influential instruments for data generation and manipulation. Enhancing the controllability of these models by selectively modifying data attributes has been a recent focus. Variational Autoencoders…

Image and Video Processing · Electrical Eng. & Systems 2023-12-15 Maxime Di Folco , Cosmin Bercea , Julia A. Schnabel

Deformable image registration is a fundamental task in medical image analysis, aiming to establish a dense and non-linear correspondence between a pair of images. Previous deep-learning studies usually employ supervised neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Jun Zhang

Dropout and similar stochastic neural network regularization methods are often interpreted as implicitly averaging over a large ensemble of models. We propose STE (stochastically trained ensemble) layers, which enhance the averaging…

Machine Learning · Computer Science 2019-11-22 Alex Labach , Shahrokh Valaee

Unsupervised deep learning approaches have recently become one of the crucial research areas in imaging owing to their ability to learn expressive and powerful reconstruction operators even when paired high-quality training data is scarcely…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Marcello Carioni , Subhadip Mukherjee , Hong Ye Tan , Junqi Tang

Block-sparse regularization is already well-known in active thermal imaging and is used for multiple measurement based inverse problems. The main bottleneck of this method is the choice of regularization parameters which differs for each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Samim Ahmadi , Jan Christian Hauffen , Linh Kästner , Peter Jung , Giuseppe Caire , Mathias Ziegler

A challenge in high-dimensional inverse problems is developing iterative solvers to find the accurate solution of regularized optimization problems with low computational cost. An important example is computed tomography (CT) where both…

Numerical Analysis · Mathematics 2024-12-16 Alessandro Perelli , Carola-Bibiane Schonlieb , Matthias J. Ehrhardt

Regularization is commonly used for alleviating overfitting in machine learning. For convolutional neural networks (CNNs), regularization methods, such as DropBlock and Shake-Shake, have illustrated the improvement in the generalization…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yi Wang , Zhen-Peng Bian , Junhui Hou , Lap-Pui Chau

Sketch-based image editing aims to synthesize and modify photos based on the structural information provided by the human-drawn sketches. Since sketches are difficult to collect, previous methods mainly use edge maps instead of sketches to…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Shuai Yang , Zhangyang Wang , Jiaying Liu , Zongming Guo

Reconstructing MRI from highly undersampled measurements is crucial for accelerating medical imaging, but is challenging due to the ill-posedness of the inverse problem. While supervised deep learning (DL) approaches have shown remarkable…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Andrew Wang , Steven McDonagh , Mike Davies

Agents trained with deep reinforcement learning algorithms are capable of performing highly complex tasks including locomotion in continuous environments. We investigate transferring the learning acquired in one task to a set of previously…

Machine Learning · Computer Science 2024-03-06 Suzan Ece Ada , Emre Ugur , H. Levent Akin

Deep learning based reconstruction methods deliver outstanding results for solving inverse problems and are therefore becoming increasingly important. A recently invented class of learning-based reconstruction methods is the so-called NETT…

Numerical Analysis · Mathematics 2021-11-16 Stephan Antholzer , Markus Haltmeier

In this work we investigate how to achieve equivariance to input transformations in deep networks, purely from data, without being given a model of those transformations. Convolutional Neural Networks (CNNs), for example, are equivariant to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Jianbo Jiao , João F. Henriques

Training state-of-the-art, deep neural networks is computationally expensive. One way to reduce the training time is to normalize the activities of the neurons. A recently introduced technique called batch normalization uses the…

Machine Learning · Statistics 2016-07-22 Jimmy Lei Ba , Jamie Ryan Kiros , Geoffrey E. Hinton

The inherent ill-posed nature of image reconstruction problems, due to limitations in the physical acquisition process, is typically addressed by introducing a regularisation term that incorporates prior knowledge about the underlying…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Naïl Khelifa , Ferdia Sherry , Carola-Bibiane Schönlieb

We consider the variational reconstruction framework for inverse problems and propose to learn a data-adaptive input-convex neural network (ICNN) as the regularization functional. The ICNN-based convex regularizer is trained adversarially…