English
Related papers

Related papers: Equivariant Deep Equilibrium Models for Imaging In…

200 papers

Deep learning is emerging as a new paradigm for solving inverse imaging problems. However, the deep learning methods often lack the assurance of traditional physics-based methods due to the lack of physical information considerations in…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 Dongdong Chen , Mike E. Davies

Implicit equilibrium models, i.e., deep neural networks (DNNs) defined by implicit equations, have been becoming more and more attractive recently. In this paper, we investigate an emerging question: can an implicit equilibrium model's…

Machine Learning · Computer Science 2021-06-08 Xingyu Xie , Qiuhao Wang , Zenan Ling , Xia Li , Yisen Wang , Guangcan Liu , Zhouchen Lin

Extensive work has demonstrated that equivariant neural networks can significantly improve sample efficiency and generalization by enforcing an inductive bias in the network architecture. These applications typically assume that the domain…

Machine Learning · Computer Science 2023-02-13 Dian Wang , Jung Yeon Park , Neel Sortur , Lawson L. S. Wong , Robin Walters , Robert Platt

Equivariance guarantees that a model's predictions capture key symmetries in data. When an image is translated or rotated, an equivariant model's representation of that image will translate or rotate accordingly. The success of…

Machine Learning · Computer Science 2024-06-19 Nate Gruver , Marc Finzi , Micah Goldblum , Andrew Gordon Wilson

Training networks consisting of biophysically accurate neuron models could allow for new insights into how brain circuits can organize and solve tasks. We begin by analyzing the extent to which the central algorithm for neural network…

Neurons and Cognition · Quantitative Biology 2023-11-22 James Hazelden , Yuhan Helena Liu , Eli Shlizerman , Eric Shea-Brown

In various imaging problems, we only have access to compressed measurements of the underlying signals, hindering most learning-based strategies which usually require pairs of signals and associated measurements for training. Learning only…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Dongdong Chen , Julián Tachella , Mike E. Davies

Recent work in machine learning shows that deep neural networks can be used to solve a wide variety of inverse problems arising in computational imaging. We explore the central prevailing themes of this emerging area and present a taxonomy…

Image and Video Processing · Electrical Eng. & Systems 2020-05-14 Gregory Ongie , Ajil Jalal , Christopher A. Metzler , Richard G. Baraniuk , Alexandros G. Dimakis , Rebecca Willett

Electroencephalography (EEG) signals are frequently used for various Brain-Computer Interface (BCI) tasks. While Deep Learning (DL) techniques have shown promising results, they are hindered by the substantial data requirements. By…

Signal Processing · Electrical Eng. & Systems 2024-05-24 Bruna Junqueira , Bruno Aristimunha , Sylvain Chevallier , Raphael Y. de Camargo

Incorporating group symmetries via equivariance into neural networks has emerged as a robust approach for overcoming the efficiency and data demands of modern deep learning. While most existing approaches, such as group convolutions and…

Deep learning (DL) inverse techniques have increased the speed of artificial electromagnetic material (AEM) design and improved the quality of resulting devices. Many DL inverse techniques have succeeded on a number of AEM design tasks, but…

Machine Learning · Computer Science 2021-12-21 Simiao Ren , Ashwin Mahendra , Omar Khatib , Yang Deng , Willie J. Padilla , Jordan M. Malof

Purpose: To develop a deep learning-based Bayesian inference for MRI reconstruction. Methods: We modeled the MRI reconstruction problem with Bayes's theorem, following the recently proposed PixelCNN++ method. The image reconstruction from…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 GuanXiong Luo , Na Zhao , Wenhao Jiang , Edward S. Hui , Peng Cao

Eigendecomposition (ED) is widely used in deep networks. However, the backpropagation of its results tends to be numerically unstable, whether using ED directly or approximating it with the Power Iteration method, particularly when dealing…

Machine Learning · Computer Science 2019-06-28 Wei Wang , Zheng Dang , Yinlin Hu , Pascal Fua , Mathieu Salzmann

Electrical impedance tomography (EIT) is an imaging modality in which the conductivity distribution inside a target is reconstructed based on voltage measurements from the surface of the target. Reconstructing the conductivity distribution…

Mathematical Physics · Physics 2012-07-05 Antti Lipponen , Aku Seppänen , Jari Kaipio

Equivariances provide useful inductive biases in neural network modeling, with the translation equivariance of convolutional neural networks being a canonical example. Equivariances can be embedded in architectures through weight-sharing…

Machine Learning · Computer Science 2022-11-15 Tycho F. A. van der Ouderaa , David W. Romero , Mark van der Wilk

The feasibility of variational quantum algorithms, the most popular correspondent of neural networks on noisy, near-term quantum hardware, is highly impacted by the circuit depth of the involved parametrized quantum circuits (PQCs). Higher…

Machine Learning · Computer Science 2024-11-01 Philipp Schleich , Marta Skreta , Lasse B. Kristensen , Rodrigo A. Vargas-Hernández , Alán Aspuru-Guzik

Deep neural networks with discrete latent variables offer the promise of better symbolic reasoning, and learning abstractions that are more useful to new tasks. There has been a surge in interest in discrete latent variable models, however,…

Machine Learning · Computer Science 2018-07-23 Aurko Roy , Ashish Vaswani , Arvind Neelakantan , Niki Parmar

Electrical Impedance Tomography (EIT) is a non-invasive medical imaging method that reconstructs electrical conductivity mediums from boundary voltage-current measurements, but its severe ill-posedness renders direct operator learning with…

Numerical Analysis · Mathematics 2026-01-14 Amit Bhat , Ke Chen , Chunmei Wang

The backpropagation algorithm remains the dominant and most successful method for training deep neural networks (DNNs). At the same time, training DNNs at scale comes at a significant computational cost and therefore a high carbon…

Machine Learning · Computer Science 2025-11-12 Sander Dalm , Joshua Offergeld , Nasir Ahmad , Marcel van Gerven

Reconstructing dynamic MRI image sequences from undersampled accelerated measurements is crucial for faster and higher spatiotemporal resolution real-time imaging of cardiac motion, free breathing motion and many other applications.…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Andrew Wang , Mike Davies

Electrical impedance tomography (EIT) is a non-invasive imaging technique, capable of reconstructing images of the electrical conductivity of tissues and materials. It is popular in diverse application areas, from medical imaging to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Shuaikai Shi , Ruiyuan Kang , Panos Liatsis