English
Related papers

Related papers: Developing a PET/CT Foundation Model for Cross-Mod…

200 papers

Despite its tremendous value for the diagnosis, treatment monitoring and surveillance of children with cancer, whole body staging with positron emission tomography (PET) is time consuming and associated with considerable radiation exposure.…

Masked autoencoders (MAEs) have displayed significant potential in the classification and semantic segmentation of medical images in the last year. Due to the high similarity of human tissues, even slight changes in medical images may…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Jiawei Mao , Shujian Guo , Yuanqi Chang , Xuesong Yin , Binling Nie

Self-supervised pre-training has proven highly effective for many computer vision tasks, particularly when labelled data are scarce. In the context of Earth Observation (EO), foundation models and various other Vision Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Jose Sosa , Mohamed Aloulou , Danila Rukhovich , Rim Sleimi , Boonyarit Changaival , Anis Kacem , Djamila Aouada

Fully supervised skeleton-based action recognition has achieved great progress with the blooming of deep learning techniques. However, these methods require sufficient labeled data which is not easy to obtain. In contrast, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Wenhan Wu , Yilei Hua , Ce Zheng , Shiqian Wu , Chen Chen , Aidong Lu

Multi-modal MR imaging is routinely used in clinical practice to diagnose and investigate brain tumors by providing rich complementary information. Previous multi-modal MRI segmentation methods usually perform modal fusion by concatenating…

Image and Video Processing · Electrical Eng. & Systems 2022-09-01 Zhaohu Xing , Lequan Yu , Liang Wan , Tong Han , Lei Zhu

Detection Transformers represent end-to-end object detection approaches based on a Transformer encoder-decoder architecture, exploiting the attention mechanism for global relation modeling. Although Detection Transformers deliver results on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Bastian Wittmann , Fernando Navarro , Suprosanna Shit , Bjoern Menze

Current artificial intelligence models for medical imaging are predominantly single modality and single disease. Attempts to create multimodal and multi-disease models have resulted in inconsistent clinical accuracy. Furthermore, training…

Simultaneous recordings from thousands of neurons across multiple brain areas reveal rich mixtures of activity that are shared between regions and dynamics that are unique to each region. Existing alignment or multi-view methods neglect…

Machine Learning · Computer Science 2025-10-24 Ram Dyuthi Sristi , Sowmya Manojna Narasimha , Jingya Huang , Alice Despatin , Simon Musall , Vikash Gilja , Gal Mishne

Pretraining and fine-tuning have emerged as a new paradigm in remote sensing image interpretation. Among them, Masked Autoencoder (MAE)-based pretraining stands out for its strong capability to learn general feature representations via…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Xiaokang Zhang , Bo Li , Chufeng Zhou , Weikang Yu , Lefei Zhang

There has been a growing interest in using deep learning models for processing long surgical videos, in order to automatically detect clinical/operational activities and extract metrics that can enable workflow efficiency tools and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Muhammad Abdullah Jamal , Omid Mohareri

Recent advancements in foundation models have significantly impacted various fields, including natural language processing, computer vision, and multi-modal tasks. One area that stands to benefit greatly is Earth observation, where these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Yohei Nakayama , Jiawei Su , Luis M. Pazos-Outón

Self-supervised pretraining has transformed computer vision by enabling data-efficient fine-tuning, yet high-resolution training typically requires server-scale infrastructure, limiting in-domain foundation model development for many…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 David Smerkous , Zian Wang , Behzad Najafian

There is substantial interest in developing artificial intelligence systems to support radiologists across tasks ranging from segmentation to report generation. Existing computed tomography (CT) foundation models have largely focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Rubén Moreno-Aguado , Alba Magallón , Victor Moreno , Yingying Fang , Guang Yang

Multimodal medical imaging provides complementary information that is crucial for accurate delineation of pathology, but the development of deep learning models is limited by the scarcity of large datasets in which different modalities are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Arunkumar V , Firos V M , Senthilkumar S , Gangadharan G R

Image reconstruction for positron emission tomography (PET) is challenging because of the ill-conditioned tomographic problem and low counting statistics. Kernel methods address this challenge by using kernel representation to incorporate…

Image and Video Processing · Electrical Eng. & Systems 2022-05-26 Siqi Li , Guobao Wang

Synthetic PET images are valuable for quantitative imaging workflow development, scalable virtual imaging trials, and deep learning model training, but conventional physics-based simulation approaches are computationally intensive, limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Suya Li , Kaushik Dutta , Debojyoti Pal , Jingqin Luo , Kooresh I. Shoghi

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Over the past two decades, machine analysis of medical imaging has advanced rapidly, opening up significant potential for several important medical applications. As complicated diseases increase and the number of cases rises, the role of…

Image and Video Processing · Electrical Eng. & Systems 2024-05-08 Fares Bougourzi , Fadi Dornaika , Cosimo Distante , Abdelmalik Taleb-Ahmed

Positron Emission Tomography (PET) is a vital imaging modality widely used in clinical diagnosis and preclinical research but faces limitations in image resolution and signal-to-noise ratio due to inherent physical degradation factors.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-11 Boxiao Yu , Kuang Gong

Background: In medical imaging, images are usually treated as deterministic, while their uncertainties are largely underexplored. Purpose: This work aims at using deep learning to efficiently estimate posterior distributions of imaging…

Image and Video Processing · Electrical Eng. & Systems 2023-03-20 Xiaofeng Liu , Thibault Marin , Tiss Amal , Jonghye Woo , Georges El Fakhri , Jinsong Ouyang