English
Related papers

Related papers: Mitigating Pretraining-Induced Attention Asymmetry…

200 papers

Shortcut learning is a phenomenon where machine learning models prioritize learning simple, potentially misleading cues from data that do not generalize well beyond the training set. While existing research primarily investigates this in…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Manxi Lin , Nina Weng , Kamil Mikolaj , Zahra Bashir , Morten Bo Søndergaard Svendsen , Martin Tolsgaard , Anders Nymark Christensen , Aasa Feragen

Objective. Standard Magnetic Resonance Imaging (MRI) reconstruction pipelines discard phase information captured during acquisition, despite evidence that it encodes tissue properties relevant to tumor diagnosis. Current machine learning…

Image and Video Processing · Electrical Eng. & Systems 2026-04-17 Marco Schlimbach , Moritz Rempe , Jessica Mnischek , Lukas T. Rotkopf , Jens Weingarten , Jens Kleesiek , Kevin Kröninger

Vision foundation models are increasingly moving beyond 2D to volumetric domains such as 3D medical imaging, where unified pretraining across different imaging modalities (i.e. CT, MRI, and PET) could provide foundational models for diverse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Ho Hin Lee , Dongna Du , Chu Wang , Yuankai Huo , Shi Gu , James C. Gee , Yifan Wu

A large portion of volumetric medical data, especially magnetic resonance imaging (MRI) data, is anisotropic, as the through-plane resolution is typically much lower than the in-plane resolution. Both 3D and purely 2D deep learning-based…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Alex Ling Yu Hung , Haoxin Zheng , Kai Zhao , Xiaoxi Du , Kaifeng Pang , Qi Miao , Steven S. Raman , Demetri Terzopoulos , Kyunghyun Sung

Medical image segmentation is a vital healthcare endeavor requiring precise and efficient models for appropriate diagnosis and treatment. Vision transformer (ViT)-based segmentation models have shown great performance in accomplishing this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Numan Saeed , Muhammad Ridzuan , Roba Al Majzoub , Mohammad Yaqub

Remarkable effectiveness of the channel or spatial attention mechanisms for producing more discernible feature representation are illustrated in various computer vision tasks. However, modeling the cross-channel relationships with channel…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Daliang Ouyang , Su He , Guozhong Zhang , Mingzhu Luo , Huaiyong Guo , Jian Zhan , Zhijie Huang

Spatial Transcriptomics (ST) profiles thousands of gene expression values at discrete spots with precise coordinates on tissue sections, preserving spatial context essential for clinical and pathological studies. With rising sequencing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yishun Zhu , Jiaxin Qi , Jian Wang , Yuhua Zheng , Jianqiang Huang

We introduce SPECTRE, a fully transformer-based foundation model for volumetric computed tomography (CT). Our Self-Supervised & Cross-Modal Pretraining for CT Representation Extraction (SPECTRE) approach utilizes scalable 3D Vision…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Cris Claessens , Christiaan Viviers , Giacomo D'Amicantonio , Egor Bondarev , Fons van der Sommen

The biological brain has inspired multiple advances in machine learning. However, most state-of-the-art models in computer vision do not operate like the human brain, simply because they are not capable of changing or improving their…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 David Calhas , João Marques , Arlindo L. Oliveira

In learning-based approaches to image compression, codecs are developed by optimizing a computational model to minimize a rate-distortion objective. Currently, the most effective learned image codecs take the form of an entropy-constrained…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 David Minnen , Saurabh Singh

In the field of medical images, although various works find Swin Transformer has promising effectiveness on pixelwise dense prediction, whether pre-training these models without using extra dataset can further boost the performance for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xinrong Hu , Dewen Zeng , Yawen Wu , Xueyang Li , Yiyu Shi

Electron and scanning probe microscopy produce vast amounts of data in the form of images or hyperspectral data, such as EELS or 4D STEM, that contain information on a wide range of structural, physical, and chemical properties of…

Machine Learning · Computer Science 2023-06-09 Arpan Biswas , Maxim Ziatdinov , Sergei V. Kalinin

Estimation of optical aberrations from volumetric intensity images is a key step in sensorless adaptive optics for 3D microscopy. Recent approaches based on deep learning promise accurate results at fast processing speeds. However,…

Image and Video Processing · Electrical Eng. & Systems 2020-10-28 Debayan Saha , Uwe Schmidt , Qinrong Zhang , Aurelien Barbotin , Qi Hu , Na Ji , Martin J. Booth , Martin Weigert , Eugene W. Myers

When using Convolutional Neural Networks (CNNs) for segmentation of organs and lesions in medical images, the conventional approach is to work with inputs and outputs either as single slice (2D) or whole volumes (3D). One common…

Image and Video Processing · Electrical Eng. & Systems 2020-11-17 Minh H. Vu , Guus Grimbergen , Tufve Nyholm , Tommy Löfstedt

Training a fine-grained image recognition model with limited data presents a significant challenge, as the subtle differences between categories may not be easily discernible amidst distracting noise patterns. One commonly employed strategy…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Avraham Chapman , Haiming Xu , Lingqiao Liu

Like other applications in computer vision, medical image segmentation has been most successfully addressed using deep learning models that rely on the convolution operation as their main building block. Convolutions enjoy important…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Davood Karimi , Serge Vasylechko , Ali Gholipour

Synthesized medical images have several important applications, e.g., as an intermedium in cross-modality image registration and as supplementary training samples to boost the generalization capability of a classifier. Especially,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Zizhao Zhang , Lin Yang , Yefeng Zheng

Deep metric learning aims to construct an embedding space where samples of the same class are close to each other, while samples of different classes are far away from each other. Most existing deep metric learning methods attempt to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Liu Pingping , Liu Zetong , Lang Yijun , Zhou Qiuzhan , Li Qingliang

The volume estimation of brain regions from MRI data is a key problem in many clinical applications, where the acquisition of data at high spatial resolution is desirable. While parallel MRI and constrained image reconstruction algorithms…

Image and Video Processing · Electrical Eng. & Systems 2021-05-20 Aniket Pramanik , Xiaodong Wu , Mathews Jacob

Image reconstruction from undersampled k-space data plays an important role in accelerating the acquisition of MR data, and a lot of deep learning-based methods have been exploited recently. Despite the achieved inspiring results, the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Chen Hu , Cheng Li , Haifeng Wang , Qiegen Liu , Hairong Zheng , Shanshan Wang