English
Related papers

Related papers: Input layer regularization and automated regulariz…

200 papers

We present a novel regularization approach to train neural networks that enjoys better generalization and test error than standard stochastic gradient descent. Our approach is based on the principles of cross-validation, where a validation…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Simon Jenni , Paolo Favaro

In this paper, the traditional model based variational method and learning based algorithms are naturally integrated to address mixed noise removal problem. To be different from single type noise (e.g. Gaussian) removal, it is a challenge…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Faqiang Wang , Haiyang Huang , Jun Liu

Deep learning has emerged as a promising approach for learning the nonlinear mapping between diffusion-weighted MR images and tissue parameters, which enables automatic and deep understanding of the brain microstructures. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Wenxin Fan , Jian Cheng , Qiyuan Tian , Ruoyou Wu , Juan Zou , Zan Chen , Shanshan Wang

Bilinear pooling achieves great success in fine-grained visual recognition (FGVC). Recent methods have shown that the matrix power normalization can stabilize the second-order information in bilinear features, but some problems, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Shaobo Min , Hantao Yao , Hongtao Xie , Zheng-Jun Zha , Yongdong Zhang

A common challenge in regression is that for many problems, the degrees of freedom required for a high-quality solution also allows for overfitting. Regularization is a class of strategies that seek to restrict the range of possible…

Machine Learning · Computer Science 2022-11-15 Colin Ponce , Ruipeng Li , Christina Mao , Panayot Vassilevski

Meta-learning that uses implicit gradient have provided an exciting alternative to standard techniques which depend on the trajectory of the inner loop training. Implicit meta-learning (IML), however, require computing $2^{nd}$ order…

Machine Learning · Computer Science 2023-10-31 Fady Rezk

Imaging is a standard example of an inverse problem, where the task of reconstructing a ground truth from a noisy measurement is ill-posed. Recent state-of-the-art approaches for imaging use deep learning, spearheaded by unrolled and…

The data consistency for the physical forward model is crucial in inverse problems, especially in MR imaging reconstruction. The standard way is to unroll an iterative algorithm into a neural network with a forward model embedded. The…

Image and Video Processing · Electrical Eng. & Systems 2023-06-28 Guanxiong Luo , Mengmeng Kuang , Peng Cao

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

Optimization and Control · Mathematics 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

Magnetic resonance imaging (MRI) is known to have reduced signal-to-noise ratios (SNR) at lower field strengths, leading to signal degradation when producing a low-field MRI image from a high-field one. Therefore, reconstructing a…

Image and Video Processing · Electrical Eng. & Systems 2023-05-05 Zhuo-Xu Cui , Congcong Liu , Chentao Cao , Yuanyuan Liu , Jing Cheng , Qingyong Zhu , Yanjie Zhu , Haifeng Wang , Dong Liang

We have formulated elastic seismic full waveform inversion (FWI) within a deep learning environment. In our formulation, a recurrent neural network is set up with rules enforcing elastic wave propagation, with the wavefield projected onto a…

Geophysics · Physics 2021-01-25 Tianze Zhang , Jian Sun , Kristopher A. Innanen , Daniel Trad

The paper proposes a novel regularization procedure for machine learning. The proposed high-order regularization (HR) provides new insight into regularization, which is widely used to train a neural network that can be utilized to…

Machine Learning · Computer Science 2025-05-14 Xinghua Liu , Ming Cao

Implicit full waveform inversion (IFWI) introduces implicit neural representations to parameterize the subsurface velocity model as a continuous function of spatial coordinates, which alleviates the dependence on the initial model and…

Geophysics · Physics 2026-05-05 Zefeng Wang , Shijun Cheng , Weijian Mao , Wei Ouyang , Huanhuan Tang

Deep neural networks show great potential for automating various visual quality inspection tasks in manufacturing. However, their applicability is limited in more volatile scenarios, such as remanufacturing, where the inspected products and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Johannes C. Bauer , Paul Geng , Stephan Trattnig , Petr Dokládal , Rüdiger Daub

Deep neural networks achieve state-of-the-art results for accelerated MRI reconstruction. Most research on deep learning based imaging focuses on improving neural network architectures trained and evaluated on fixed and homogeneous training…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Kang Lin , Anselm Krainovic , Kun Wang , Reinhard Heckel

Image registration is an ill-posed inverse problem which often requires regularisation on the solution space. In contrast to most of the current approaches which impose explicit regularisation terms such as smoothness, in this paper we…

Image and Video Processing · Electrical Eng. & Systems 2020-07-09 Chen Qin , Shuo Wang , Chen Chen , Huaqi Qiu , Wenjia Bai , Daniel Rueckert

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

Deep Learning (DL) is considered the state-of-the-art in computer vision, speech recognition and natural language processing. Until recently, it was also widely accepted that DL is irrelevant for learning tasks on tabular data, especially…

Machine Learning · Computer Science 2021-06-30 Karim Lounici , Katia Meziani , Benjamin Riu

The purpose of training neural networks is to achieve high generalization performance on unseen inputs. However, when trained on imbalanced datasets, a model's prediction tends to favor majority classes over minority classes, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Hiroaki Aizawa , Yuta Naito , Kohei Fukuda

The main focus of this work is a novel framework for the joint reconstruction and segmentation of parallel MRI (PMRI) brain data. We introduce an image domain deep network for calibrationless recovery of undersampled PMRI data. The proposed…

Image and Video Processing · Electrical Eng. & Systems 2021-02-03 Aniket Pramanik , Mathews Jacob