English
Related papers

Related papers: Test-Time Training Can Close the Natural Distribut…

200 papers

Due to inappropriate sample selection and limited training data, a distribution shift often exists between the training and test sets. This shift can adversely affect the test performance of Graph Neural Networks (GNNs). Existing approaches…

Machine Learning · Computer Science 2023-10-16 Rui Ding , Jielong Yang , Feng Ji , Xionghu Zhong , Linbo Xie

It has been demonstrated that deep neural networks outperform traditional machine learning. However, deep networks lack generalisability, that is, they will not perform as good as in a new (testing) set drawn from a different distribution…

Machine Learning · Computer Science 2022-06-28 Bruno Casella , Alessio Barbaro Chisari , Sebastiano Battiato , Mario Valerio Giuffrida

Deep neural networks have excelled on a wide range of problems, from vision to language and game playing. Neural networks very gradually incorporate information into weights as they process data, requiring very low learning rates. If the…

Dynamic Magnetic Resonance Imaging (MRI) is a crucial non-invasive method used to capture the movement of internal organs and tissues, making it a key tool for medical diagnosis. However, dynamic MRI faces a major challenge: long…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Tamir Shor , Chaim Baskin , Alex Bronstein

Recent studies show that deep learning (DL) based MRI reconstruction outperforms conventional methods, such as parallel imaging and compressed sensing (CS), in multiple applications. Unlike CS that is typically implemented with…

Image and Video Processing · Electrical Eng. & Systems 2022-08-22 Hongyi Gu , Burhaneddin Yaman , Steen Moeller , Il Yong Chun , Mehmet Akçakaya

We propose a novel method for compressed sensing recovery using untrained deep generative models. Our method is based on the recently proposed Deep Image Prior (DIP), wherein the convolutional weights of the network are optimized to match…

Magnetic Resonance Imaging (MRI) is a powerful medical imaging modality, but unfortunately suffers from long scan times which, aside from increasing operational costs, can lead to image artifacts due to patient motion. Motion during the…

Image and Video Processing · Electrical Eng. & Systems 2023-10-02 Brett Levac , Sidharth Kumar , Ajil Jalal , Jonathan I. Tamir

Magnetic resonance imaging (MRI) is known to be a slow imaging modality and undersampling in k-space has been used to increase the imaging speed. However, image reconstruction from undersampled k-space data is an ill-posed inverse problem.…

Image and Video Processing · Electrical Eng. & Systems 2019-08-08 Jing Cheng , Haifeng Wang , Leslie Ying , Dong Liang

The success of deep learning has set new benchmarks for many medical image analysis tasks. However, deep models often fail to generalize in the presence of distribution shifts between training (source) data and test (target) data. One…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Dwarikanath Mahapatra

We propose Neural Priming, a technique for adapting large pretrained models to distribution shifts and downstream tasks given few or no labeled examples. Presented with class names or unlabeled test samples, Neural Priming enables the model…

Deep neural networks achieve state-of-the-art results for accelerated MRI reconstruction. Most research on deep learning based imaging focuses on improving neural network architectures trained and evaluated on fixed and homogeneous training…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Kang Lin , Anselm Krainovic , Kun Wang , Reinhard Heckel

Recent medical image reconstruction techniques focus on generating high-quality medical images suitable for clinical use at the lowest possible cost and with the fewest possible adverse effects on patients. Recent works have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Shijun Liang , Anish Lahiri , Saiprasad Ravishankar

In dynamic decision-making scenarios across business and healthcare, leveraging sample trajectories from diverse populations can significantly enhance reinforcement learning (RL) performance for specific target populations, especially when…

Machine Learning · Statistics 2025-04-15 Jinhang Chai , Elynn Chen , Jianqing Fan

Deep neural networks rely heavily on normalization methods to improve their performance and learning behavior. Although normalization methods spurred the development of increasingly deep and efficient architectures, they also increase the…

Machine Learning · Computer Science 2021-10-06 Alexander Fuchs , Christian Knoll , Franz Pernkopf

Compressed sensing (CS) MRI relies on adequate undersampling of the k-space to accelerate the acquisition without compromising image quality. Consequently, the design of optimal sampling patterns for these k-space coefficients has received…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Iris A. M. Huijben , Bastiaan S. Veeling , Ruud J. G. van Sloun

Convolutional Neural Networks (CNNs) work very well for supervised learning problems when the training dataset is representative of the variations expected to be encountered at test time. In medical image segmentation, this premise is…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Neerav Karani , Ertunc Erdil , Krishna Chaitanya , Ender Konukoglu

The dominating NLP paradigm of training a strong neural predictor to perform one task on a specific dataset has led to state-of-the-art performance in a variety of applications (eg. sentiment classification, span-prediction based question…

Computation and Language · Computer Science 2021-09-06 Paul Michel

Deep neural networks have useful applications in many different tasks, however their performance can be severely affected by changes in the data distribution. For example, in the biomedical field, their performance can be affected by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Pedro Vianna , Muawiz Chaudhary , Paria Mehrbod , An Tang , Guy Cloutier , Guy Wolf , Michael Eickenberg , Eugene Belilovsky

Deep neural networks often produce overconfident predictions, undermining their reliability in safety-critical applications. This miscalibration is further exacerbated under distribution shift, where test data deviates from the training…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Yilin Zhang , Cai Xu , You Wu , Ziyu Guan , Wei Zhao

Modern computer vision requires processing large amounts of data, both while training the model and/or during inference, once the model is deployed. Scenarios where images are captured and processed in physically separated locations are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sudeep Katakol , Basem Elbarashy , Luis Herranz , Joost van de Weijer , Antonio M. Lopez