English
Related papers

Related papers: Equivariant Test-Time Training with Operator Sketc…

200 papers

This paper investigates ensemble Kalman inversion (EKI) for variational inverse problems with convex, potentially non-smooth regularization. While deterministic EKI and its Tikhonov-regularized variants have primarily been analyzed for…

Numerical Analysis · Mathematics 2026-03-24 Simon Weissmann

Regularization is critical for solving ill-posed geophysical inverse problems. Explicit regularization is often used, but there are opportunities to explore the implicit regularization effects that are inherent in a Neural Network…

Machine Learning · Computer Science 2024-07-10 Anran Xu , Lindsey J. Heagy

In various imaging problems, we only have access to compressed measurements of the underlying signals, hindering most learning-based strategies which usually require pairs of signals and associated measurements for training. Learning only…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Dongdong Chen , Julián Tachella , Mike E. Davies

In deep neural nets, lower level embedding layers account for a large portion of the total number of parameters. Tikhonov regularization, graph-based regularization, and hard parameter sharing are approaches that introduce explicit biases…

Machine Learning · Computer Science 2020-10-06 Liwei Wu , Shuqing Li , Cho-Jui Hsieh , James Sharpnack

This work investigates use of equivariant neural networks as efficient and high-performance frameworks for image reconstruction and denoising in nuclear medicine. Our work aims to tackle limitations of conventional Convolutional Neural…

Image and Video Processing · Electrical Eng. & Systems 2025-02-03 Amirreza Hashemi , Yuemeng Feng , Arman Rahmim , Hamid Sabet

Exemplar-guided Image Editing (EIE) aims to modify a source image according to a visual reference. Existing approaches often require large-scale pre-training to learn relationships between the source and reference images, incurring high…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yuke Li , Lianli Gao , Ji Zhang , Pengpeng Zeng , Lichuan Xiang , Hongkai Wen , Heng Tao Shen , Jingkuan Song

The regularized D-bar method is a popular method for solving Electrical Impedance Tomography (EIT) problems due to its efficiency and simplicity. It utilizes the low-pass truncated scattering data in the non-linear Fourier domain to solve…

Numerical Analysis · Mathematics 2025-02-10 Xiang Cao , Qiaoqiao Ding , Xiaoqun Zhang

Global covariance pooling in convolutional neural networks has achieved impressive improvement over the classical first-order pooling. Recent works have shown matrix square root normalization plays a central role in achieving…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Peihua Li , Jiangtao Xie , Qilong Wang , Zilin Gao

Electrical Impedance Tomography (EIT) is a non-invasive medical imaging method that reconstructs electrical conductivity mediums from boundary voltage-current measurements, but its severe ill-posedness renders direct operator learning with…

Numerical Analysis · Mathematics 2026-01-14 Amit Bhat , Ke Chen , Chunmei Wang

Recently, regularization model-driven deep learning (DL) has gained significant attention due to its ability to leverage the potent representational capabilities of DL while retaining the theoretical guarantees of regularization models.…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Chen Luo , Huayu Wang , Taofeng Xie , Qiyu Jin , Guoqing Chen , Zhuo-Xu Cui , Dong Liang

From early image processing to modern computational imaging, successful models and algorithms have relied on a fundamental property of natural signals: symmetry. Here symmetry refers to the invariance property of signal sets to…

Signal Processing · Electrical Eng. & Systems 2022-09-07 Dongdong Chen , Mike Davies , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb , Ferdia Sherry , Julián Tachella

Many successful deep learning architectures are equivariant to certain transformations in order to conserve parameters and improve generalization: most famously, convolution layers are equivariant to shifts of the input. This approach only…

Machine Learning · Computer Science 2021-03-31 Allan Zhou , Tom Knowles , Chelsea Finn

This paper aims to numerically solve the two-dimensional electrical impedance tomography (EIT) with Cauchy data. This inverse problem is highly challenging due to its severe ill-posed nature and strong nonlinearity, which necessitates…

Numerical Analysis · Mathematics 2025-07-22 Kai Li , Kwancheol Shin , Zhi Zhou

Deep learning has made profound impacts in the domains of data mining and AI, distinguished by the groundbreaking achievements in numerous real-world applications and the innovative algorithm design philosophy. However, it suffers from the…

Machine Learning · Computer Science 2024-09-24 Di Wang , Shao-Bo Lin , Deyu Meng , Feilong Cao

Equivariant networks are specifically designed to ensure consistent behavior with respect to a set of input transformations, leading to higher sample efficiency and more accurate and robust predictions. However, redesigning each component…

Machine Learning · Computer Science 2023-10-31 Arnab Kumar Mondal , Siba Smarak Panigrahi , Sékou-Oumar Kaba , Sai Rajeswar , Siamak Ravanbakhsh

Graph Neural Networks (GNNs) are widely applied to graph learning problems such as node classification. When scaling up the underlying graphs of GNNs to a larger size, we are forced to either train on the complete graph and keep the full…

Machine Learning · Computer Science 2024-06-25 Mucong Ding , Tahseen Rabbani , Bang An , Evan Z Wang , Furong Huang

Purpose: Parallel imaging and compressed sensing reconstructions of large MRI datasets often have a prohibitive computational cost that bottlenecks clinical deployment, especially for 3D non-Cartesian acquisitions. One common approach is to…

Image and Video Processing · Electrical Eng. & Systems 2023-10-13 Julio A. Oscanoa , Frank Ong , Siddharth S. Iyer , Zhitao Li , Christopher M. Sandino , Batu Ozturkler , Daniel B. Ennis , Mert Pilanci , Shreyas S. Vasanawala

Pre-trained deep image representations are useful for post-training tasks such as classification through transfer learning, image retrieval, and object detection. Data augmentations are a crucial aspect of pre-training robust…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Sangnie Bhardwaj , Willie McClinton , Tongzhou Wang , Guillaume Lajoie , Chen Sun , Phillip Isola , Dilip Krishnan

Magnetic resonance imaging (MRI) is a vital clinical diagnostic tool, yet its application is limited by prolonged scan times. Accelerating MRI reconstruction addresses this issue by reconstructing high-fidelity MR images from undersampled…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Jingran Xu , Yuanyuan Liu , Yuanbiao Yang , Zhuo-Xu Cui , Jing Cheng , Qingyong Zhu , Nannan Zhang , Yihang Zhou , Dong Liang , Yanjie Zhu

Recently, deep unfolding methods that guide the design of deep neural networks (DNNs) through iterative algorithms have received increasing attention in the field of inverse problems. Unlike general end-to-end DNNs, unfolding methods have…

Optimization and Control · Mathematics 2022-11-28 Zhuo-Xu Cui , Qingyong Zhu , Jing Cheng , Dong Liang