English
Related papers

Related papers: Developing a PET/CT Foundation Model for Cross-Mod…

200 papers

Recently, self-supervised pre-training has advanced Vision Transformers on various tasks w.r.t. different data modalities, e.g., image and 3D point cloud data. In this paper, we explore this learning paradigm for 3D mesh data analysis based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yaqian Liang , Shanshan Zhao , Baosheng Yu , Jing Zhang , Fazhi He

Positron Emission Tomography (PET) imaging requires accurate attenuation correction (AC) to account for photon loss due to tissue density variations. In PET/MR systems, computed tomography (CT), which offers a straightforward estimation of…

Image and Video Processing · Electrical Eng. & Systems 2025-04-11 Weijie Chen , James Wang , Alan McMillan

Radiotherapists require accurate registration of MR/CT images to effectively use information from both modalities. In a typical registration pipeline, rigid or affine transformations are applied to roughly align the fixed and moving images…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Xiaoyu Bai , Fan Bai , Xiaofei Huo , Jia Ge , Tony C. W. Mok , Zi Li , Minfeng Xu , Jingren Zhou , Le Lu , Dakai Jin , Xianghua Ye , Jingjing Lu , Ke Yan

Dynamic positron emission tomography (PET) images can reveal the distribution of tracers in the organism and the dynamic processes involved in biochemical reactions, and it is widely used in clinical practice. Despite the high effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-12-22 Jie Sun , Junyan Zhang , Qian Xia , Chuanfu Sun , Yumei Chen , Yunjie Yang , Huafeng Liu , Wentao Zhu , Qiegen Liu

Positron emission tomography (PET) is a well-established functional imaging technique for diagnosing brain disorders. However, PET's high costs and radiation exposure limit its widespread use. In contrast, magnetic resonance imaging (MRI)…

Image and Video Processing · Electrical Eng. & Systems 2024-10-24 Yitong Li , Igor Yakushev , Dennis M. Hedderich , Christian Wachinger

Over the past decade, convolutional neural networks (CNN) have shown very competitive performance in medical image analysis tasks, such as disease classification, tumor segmentation, and lesion detection. CNN has great advantages in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Yin Dai , Yifan Gao

Cone-beam computed tomography (CBCT) is an important tool facilitating computer aided interventions, despite often suffering from artifacts that pose challenges for accurate interpretation. While the degraded image quality can affect…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Maximilian E. Tschuchnig , Philipp Steininger , Michael Gadermayr

Quantitative imaging is an important feature of spectral X-ray and CT systems, especially photon-counting CT (PCCT) imaging systems, which is achieved through material decomposition (MD) using spectral measurements. In this work, we present…

Medical Physics · Physics 2026-03-04 Sen Wang , Yirong Yang , Jooho Lee , Grant M. Stevens , Adam S. Wang

Biosignals acquired from different locations on the body often provide temporally ordered views of the same underlying physiological process. However, most existing self supervised learning methods treat these signals as interchangeable…

Images from Positron Emission Tomography (PET) deliver functional data such as perfusion and metabolism. On the other hand, images from Magnetic Resonance Imaging (MRI) provide information describing anatomical structures. Fusing the…

Image and Video Processing · Electrical Eng. & Systems 2018-06-19 Hiliwi Leake Kidane , Stephanie Bricq , Alain Lalande

Over the past decade, Deep Convolutional Neural Networks have been widely adopted for medical image segmentation and shown to achieve adequate performance. However, due to the inherent inductive biases present in the convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Jeya Maria Jose Valanarasu , Poojan Oza , Ilker Hacihaliloglu , Vishal M. Patel

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

Magnetic resonance imaging (MRI) and positron emission tomography (PET) are increasingly used in multimodal analysis of neurodegenerative disorders. While MRI is broadly utilized in clinical settings, PET is less accessible. Many studies…

Image and Video Processing · Electrical Eng. & Systems 2024-11-13 Minhui Yu , Mengqi Wu , Ling Yue , Andrea Bozoki , Mingxia Liu

PET imaging is widely employed for observing biological metabolic activities within the human body. However, numerous benign conditions can cause increased uptake of radiopharmaceuticals, confounding differentiation from malignant tumors.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Ran Hong , Yuxia Huang , Lei Liu , Zhonghui Wu , Bingxuan Li , Xuemei Wang , Qiegen Liu

In this paper, we propose TransMEF, a transformer-based multi-exposure image fusion framework that uses self-supervised multi-task learning. The framework is based on an encoder-decoder network, which can be trained on large natural image…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Linhao Qu , Shaolei Liu , Manning Wang , Zhijian Song

Electroencephalography (EEG) is a non-invasive technique for recording brain activity, widely used in brain-computer interfaces, clinic, and healthcare. Traditional EEG deep models typically focus on specific dataset and task, limiting…

Signal Processing · Electrical Eng. & Systems 2025-09-03 Ang Li , Zikai Wang , Liuyin Yang , Zhenyu Wang , Tianheng Xu , Honglin Hu , Marc M. Van Hulle

Cardiac biosignals, such as electrocardiograms (ECG) and photoplethysmograms (PPG), are of paramount importance for the diagnosis, prevention, and management of cardiovascular diseases, and have been extensively used in a variety of…

Existing multi-modal learning methods on fundus and OCT images mostly require both modalities to be available and strictly paired for training and testing, which appears less practical in clinical scenarios. To expand the scope of clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Lehan Wang , Chongchong Qi , Chubin Ou , Lin An , Mei Jin , Xiangbin Kong , Xiaomeng Li

This article discusses the opportunities, applications and future directions of large-scale pre-trained models, i.e., foundation models, for analyzing medical images. Medical foundation models have immense potential in solving a wide range…

Image and Video Processing · Electrical Eng. & Systems 2023-11-23 Shaoting Zhang , Dimitris Metaxas

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…