English
Related papers

Related papers: One Hyper-Initializer for All Network Architecture…

200 papers

Comprehensive surgical planning require complex patient-specific anatomical models. For instance, functional muskuloskeletal simulations necessitate all relevant structures to be segmented, which could be performed in real-time using deep…

Image and Video Processing · Electrical Eng. & Systems 2019-05-20 Firat Ozdemir , Orcun Goksel

In this report we present an unsupervised image registration framework, using a pre-trained deep neural network as a feature extractor. We refer this to zero-shot learning, due to nonoverlap between training and testing dataset (none of the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Avinash Kori , Ganapathi Krishnamurthi

Informed by the basic geometry underlying feed forward neural networks, we initialize the weights of the first layer of a neural network using the linear discriminants which best distinguish individual classes. Networks initialized in this…

Machine Learning · Computer Science 2020-08-19 Marissa Masden , Dev Sinha

In the recent years impressive advances were made for single image super-resolution. Deep learning is behind a big part of this success. Deep(er) architecture design and external priors modeling are the key ingredients. The internal…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Yudong Liang , Radu Timofte , Jinjun Wang , Yihong Gong , Nanning Zheng

Image segmentation is widely used in a variety of computer vision tasks, such as object localization and recognition, boundary detection, and medical imaging. This thesis proposes deep learning architectures to improve automatic object…

Image and Video Processing · Electrical Eng. & Systems 2019-09-24 Debleena Sengupta

Traditional model-based image reconstruction (MBIR) methods combine forward and noise models with simple object priors. Recent machine learning methods for image reconstruction typically involve supervised learning or unsupervised learning,…

Signal Processing · Electrical Eng. & Systems 2023-03-13 Siqi Ye , Zhipeng Li , Michael T. McCann , Yong Long , Saiprasad Ravishankar

Pretraining a neural network on a large dataset is becoming a cornerstone in machine learning that is within the reach of only a few communities with large-resources. We aim at an ambitious goal of democratizing pretraining. Towards that…

Machine Learning · Computer Science 2023-06-01 Boris Knyazev , Doha Hwang , Simon Lacoste-Julien

A new design methodology for neural networks that is guided by traditional algorithm design is presented. To prove our point, we present two heuristics and demonstrate an algorithmic technique for incorporating additional weights in their…

Machine Learning · Computer Science 2018-06-07 Abhejit Rajagopal , Shivkumar Chandrasekaran , Hrushikesh N. Mhaskar

Image denoising is a well studied problem with an extensive activity that has spread over several decades. Despite the many available denoising algorithms, the quest for simple, powerful and fast denoisers is still an active and vibrant…

Image and Video Processing · Electrical Eng. & Systems 2021-03-26 Gregory Vaksman , Michael Elad , Peyman Milanfar

Recently, model-driven deep learning unrolls a certain iterative algorithm of a regularization model into a cascade network by replacing the first-order information (i.e., (sub)gradient or proximal operator) of the regularizer with a…

Machine Learning · Computer Science 2021-12-24 Zhuo-Xu Cui , Jing Cheng , Qingyong Zhu , Yuanyuan Liu , Sen Jia , Kankan Zhao , Ziwen Ke , Wenqi Huang , Haifeng Wang , Yanjie Zhu , Dong Liang

Image fusion plays a key role in a variety of multi-sensor-based vision systems, especially for enhancing visual quality and/or extracting aggregated features for perception. However, most existing methods just consider image fusion as an…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Risheng Liu , Zhu Liu , Jinyuan Liu , Xin Fan , Zhongxuan Luo

Deep Learning (DL) requires a large amount of training data to provide quality outcomes. However, the field of medical imaging suffers from the lack of sufficient data for properly training DL models because medical images require manual…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Laith Alzubaidi , J. Santamaría , Mohamed Manoufali , Beadaa Mohammed , Mohammed A. Fadhel , Jinglan Zhang , Ali H. Al-Timemy , Omran Al-Shamma , Ye Duan

Optical neural networks are emerging as powerful machine learning and information processing tools because of their potential advantages in speed and energy efficiency. The training methods of these physical models, however, remain…

Optics · Physics 2026-05-11 Xudong Lv , Yuxiang Sun , Shuo Wang , Nanxing Chen , Jun Guan , Jingtian Hu

Nowadays an ever-growing concerning phenomenon, the emergence of algorithmic biases that can lead to unfair models, emerges. Several debiasing approaches have been proposed in the realm of deep learning, employing more or less sophisticated…

Machine Learning · Computer Science 2024-07-22 Rémi Nahon , Ivan Luiz De Moura Matos , Van-Tam Nguyen , Enzo Tartaglione

The growing complexity and scale of visual model pre-training have made developing and deploying multi-task computer-aided diagnosis (CAD) systems increasingly challenging and resource-intensive. Furthermore, the medical imaging community…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Yitao Zhu , Yuan Yin , Zhenrong Shen , Zihao Zhao , Haiyu Song , Sheng Wang , Dinggang Shen , Qian Wang

Recent image inpainting methods have shown promising results due to the power of deep learning, which can explore external information available from the large training dataset. However, many state-of-the-art inpainting networks are still…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Eunhye Lee , Jeongmu Kim , Jisu Kim , Tae Hyun Kim

Standard practice in training neural networks involves initializing the weights in an independent fashion. The results of recent work suggest that feature "diversity" at initialization plays an important role in training the network.…

Machine Learning · Computer Science 2020-07-06 Yaniv Blumenfeld , Dar Gilboa , Daniel Soudry

We propose a novel unsupervised deep-learning-based algorithm for dynamic magnetic resonance imaging (MRI) reconstruction. Dynamic MRI requires rapid data acquisition for the study of moving organs such as the heart. Existing reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Jaejun Yoo , Kyong Hwan Jin , Harshit Gupta , Jerome Yerly , Matthias Stuber , Michael Unser

Post-training dropout based approaches achieve high sparsity and are well established means of deciphering problems relating to computational cost and overfitting in Neural Network architectures. Contrastingly, pruning at initialization is…

Neural and Evolutionary Computing · Computer Science 2022-09-07 Maham Haroon

Although interpretable prototype networks have improved the transparency of deep learning image classification, the need for multiple prototypes in collaborative decision-making increases cognitive complexity and hinders user understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Yitao Peng , Lianghua He , Hongzhou Chen