English
Related papers

Related papers: Mitigating Pretraining-Induced Attention Asymmetry…

200 papers

The quality of patient care associated with diagnostic radiology is proportionate to a physician workload. Segmentation is a fundamental limiting precursor to both diagnostic and therapeutic procedures. Advances in machine learning (ML) aim…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Ahmed Ghorbel , Ahmed Aldahdooh , Shadi Albarqouni , Wassim Hamidouche

Segmentation models are important tools for the detection and analysis of lesions in brain MRI. Depending on the type of brain pathology that is imaged, MRI scanners can acquire multiple, different image modalities (contrasts). Most…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Anthony P. Addison , Felix Wagner , Wentian Xu , Natalie Voets , Konstantinos Kamnitsas

Purpose: Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally network performance should be optimized by drawing the training and testing data from the same domain. In practice, however,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Salman Ul Hassan Dar , Muzaffer Özbey , Ahmet Burak Çatlı , Tolga Çukur

Large, pretrained models are commonly finetuned with imagery that is heavily augmented to mimic different conditions and scales, with the resulting models used for various tasks with imagery from a range of spatial scales. Such models…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Colorado J. Reed , Ritwik Gupta , Shufan Li , Sarah Brockman , Christopher Funk , Brian Clipp , Kurt Keutzer , Salvatore Candido , Matt Uyttendaele , Trevor Darrell

We propose a new method for embedding graphs while preserving directed edge information. Learning such continuous-space vector representations (or embeddings) of nodes in a graph is an important first step for using network information…

Machine Learning · Computer Science 2017-09-15 Sami Abu-El-Haija , Bryan Perozzi , Rami Al-Rfou

Transfer learning has become a standard practice to mitigate the lack of labeled data in medical classification tasks. Whereas finetuning a downstream task using supervised ImageNet pretrained features is straightforward and extensively…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Tuan Truong , Sadegh Mohammadi , Matthias Lenga

Motivated by the fact that forward and backward passes of a deep network naturally form symmetric mappings between input and output representations, we introduce a simple yet effective self-supervised vision model pretraining framework…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Ze Wang , Jiang Wang , Zicheng Liu , Qiang Qiu

Transfer learning makes it possible to use large vision networks on a variety of domains, by specializing their models' general filters to new tasks. However, these networks assume the input images to have 3 input channels, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Mariette Schönfeld , Laurens Devos , Wannes Meert , Hendrik Blockeel

We propose to adapt segmentation networks with a constrained formulation, which embeds domain-invariant prior knowledge about the segmentation regions. Such knowledge may take the form of simple anatomical information, e.g., structure size…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Mathilde Bateson , Jose Dolz , Hoel Kervadec , Hervé Lombaert , Ismail Ben Ayed

The visual models pretrained on large-scale benchmarks encode general knowledge and prove effective in building more powerful representations for downstream tasks. Most existing approaches follow the fine-tuning paradigm, either by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Nan Zhou , Jiaxin Chen , Di Huang

In this work, we explore the potential of self-supervised learning with Generative Adversarial Networks (GANs) for electron microscopy datasets. We show how self-supervised pretraining facilitates efficient fine-tuning for a spectrum of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Bashir Kazimi , Karina Ruzaeva , Stefan Sandfeld

In medical imaging analysis, deep learning has shown promising results. We frequently rely on volumetric data to segment medical images, necessitating the use of 3D architectures, which are commended for their capacity to capture interslice…

Image and Video Processing · Electrical Eng. & Systems 2023-05-18 Ikboljon Sobirov , Numan Saeed , Mohammad Yaqub

The intrinsic difficulty in adapting deep learning models to non-stationary environments limits the applicability of neural networks to real-world tasks. This issue is critical in practical supervised learning settings, such as the ones in…

Machine Learning · Computer Science 2023-06-09 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci , Tinne Tuytelaars

Objective functions that optimize deep neural networks play a vital role in creating an enhanced feature representation of the input data. Although cross-entropy-based loss formulations have been extensively used in a variety of supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Deen Dayal Mohan , Bhavin Jawade , Srirangaraj Setlur , Venu Govindaraj

Due to the difficulties of obtaining multimodal paired images in clinical practice, recent studies propose to train brain tumor segmentation models with unpaired images and capture complementary information through modality translation.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Zecheng Liu , Jia Wei , Rui Li

Purpose. Given the high level of expertise required for navigation and interpretation of ultrasound images, computational simulations can facilitate the training of such skills in virtual reality. With ray-tracing based simulations,…

Image and Video Processing · Electrical Eng. & Systems 2021-01-22 Lin Zhang , Tiziano Portenier , Orcun Goksel

By pretraining to synthesize coherent images from perturbed inputs, generative models inherently learn to understand object boundaries and scene compositions. How can we repurpose these generative representations for general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Om Khangaonkar , Hamed Pirsiavash

The hematology analytics used for detection and classification of small blood components is a significant challenge. In particular, when objects exists as small pixel-sized entities in a large context of similar objects. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 H. Martin Gillis , Ming Hill , Paul Hollensen , Alan Fine , Thomas Trappenberg

Diffusion MRI (dMRI) of the developing brain can provide valuable insights into the white matter development. However, slice thickness in fetal dMRI is typically high (i.e., 3-5 mm) to freeze the in-plane motion, which reduces the…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Hamza Kebiri , Gabriel Girard , Yasser Aleman-Gomez , Thomas Yu , Andras Jakab , Erick Jorge Canales-Rodriguez , Meritxell Bach Cuadra

Obtaining manual annotations for large datasets for supervised training of deep learning (DL) models is challenging. The availability of large unlabeled datasets compared to labeled ones motivate the use of self-supervised pretraining to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Lavanya Umapathy , Zhiyang Fu , Rohit Philip , Diego Martin , Maria Altbach , Ali Bilgin