English
Related papers

Related papers: Anatomically Constrained Transformers for Echocard…

200 papers

The accurate segmentation of Coronary Computed Tomography Angiography (CCTA) images holds substantial clinical value for the early detection and treatment of Coronary Heart Disease (CHD). The Transformer, utilizing a self-attention…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Chenchu Xu , Meng Li , Xue Wu

Foundation models have recently gained significant attention because of their generalizability and adaptability across multiple tasks and data distributions. Although medical foundation models have emerged, solutions for cardiac imaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Sekeun Kim , Pengfei Jin , Sifan Song , Cheng Chen , Yiwei Li , Hui Ren , Xiang Li , Tianming Liu , Quanzheng Li

Quantitative photoacoustic computed tomography (qPACT) is a promising imaging modality for estimating physiological parameters such as blood oxygen saturation. However, developing robust qPACT reconstruction methods remains challenging due…

Medical Physics · Physics 2025-10-07 Refik Mert Cam , Seonyeong Park , Umberto Villa , Mark A. Anastasio

Masked Autoencoders (MAEs) have been shown to be effective in pre-training Vision Transformers (ViTs) for natural and medical image analysis problems. By reconstructing missing pixel/voxel information in visible patches, a ViT encoder can…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Pengfei Gu , Huimin Li , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Chest computed tomography (CT) is central to the detection and management of thoracic disease, yet the growing scale and complexity of volumetric imaging increasingly exceed what can be addressed by scan-level prediction alone. Clinically…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xuguang Bai , Mingxuan Liu , Tongxi Song , Yifei Chen , Hongjia Yang , Kasidit Anmahapong , Zihan Li , Ying Zhou , Qiyuan Tian

Vision Transformer (ViT) has shown high potential in video recognition, owing to its flexible design, adaptable self-attention mechanisms, and the efficacy of masked pre-training. Yet, it remains unclear how to adapt these pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Min Yang , Huan Gao , Ping Guo , Limin Wang

Limited-angle computed tomography (LACT) offers improved temporal resolution and reduced radiation dose for cardiac imaging, but suffers from severe artifacts due to truncated projections. To address the ill-posedness of LACT…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Yu Shi , Shuyi Fan , Changsheng Fang , Shuo Han , Haodong Li , Li Zhou , Bahareh Morovati , Dayang Wang , Hengyong Yu

In this study, we demonstrate the application of a hybrid Vision Transformer (ViT) model, pretrained on ImageNet, on an electroencephalogram (EEG) regression task. Despite being originally trained for image classification tasks, when…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Ruiqi Yang , Eric Modesitt

The quality of patient care associated with diagnostic radiology is proportionate to a physician workload. Segmentation is a fundamental limiting precursor to both diagnostic and therapeutic procedures. Advances in machine learning (ML) aim…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Ahmed Ghorbel , Ahmed Aldahdooh , Shadi Albarqouni , Wassim Hamidouche

The accurate analysis of medical images is vital for diagnosing and predicting medical conditions. Traditional approaches relying on radiologists and clinicians suffer from inconsistencies and missed diagnoses. Computer-aided diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yulong Shisu , Susano Mingwin , Yongshuai Wanwag , Zengqiang Chenso , Sunshin Huing

Purpose: Echocardiographic interpretation requires video-level reasoning and guideline-based measurement analysis, which current deep learning models for cardiac ultrasound do not support. We present EchoAgent, a framework that enables…

Recently, the advancement of self-supervised learning techniques, like masked autoencoders (MAE), has greatly influenced visual representation learning for images and videos. Nevertheless, it is worth noting that the predominant approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Gensheng Pei , Tao Chen , Xiruo Jiang , Huafeng Liu , Zeren Sun , Yazhou Yao

Recent advances in pre-trained vision transformers have shown promise in parameter-efficient audio-visual learning without audio pre-training. However, few studies have investigated effective methods for aligning multimodal features in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Tanvir Mahmud , Shentong Mo , Yapeng Tian , Diana Marculescu

Existing foundation models (FMs) in the medical domain often require extensive fine-tuning or rely on training resource-intensive decoders, while many existing encoders are pretrained with objectives biased toward specific tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tim Veenboer , George Yiasemis , Eric Marcus , Vivien Van Veldhuizen , Cees G. M. Snoek , Jonas Teuwen , Kevin B. W. Groot Lipman

Breast cancer detection through mammography interpretation remains difficult because of the minimal nature of abnormalities that experts need to identify alongside the variable interpretations between readers. The potential of CNNs for…

Image and Video Processing · Electrical Eng. & Systems 2025-08-11 Ojonugwa Oluwafemi Ejiga Peter , Daniel Emakporuena , Bamidele Dayo Tunde , Maryam Abdulkarim , Abdullahi Bn Umar

Despite their outstanding accuracy, semi-supervised segmentation methods based on deep neural networks can still yield predictions that are considered anatomically impossible by clinicians, for instance, containing holes or disconnected…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Ping Wang , Jizong Peng , Marco Pedersoli , Yuanfeng Zhou , Caiming Zhang , Christian Desrosiers

Detection Transformers represent end-to-end object detection approaches based on a Transformer encoder-decoder architecture, exploiting the attention mechanism for global relation modeling. Although Detection Transformers deliver results on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Bastian Wittmann , Fernando Navarro , Suprosanna Shit , Bjoern Menze

Vision Transformer (ViT) has become one of the most popular neural architectures due to its great scalability, computational efficiency, and compelling performance in many vision tasks. However, ViT has shown inferior performance to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Junfei Xiao , Yutong Bai , Alan Yuille , Zongwei Zhou

Vision Transformers (ViTs) have shown remarkable performance and scalability across various computer vision tasks. To apply single-scale ViTs to image segmentation, existing methods adopt a convolutional adapter to generate multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Tommie Kerssies , Niccolò Cavagnero , Alexander Hermans , Narges Norouzi , Giuseppe Averta , Bastian Leibe , Gijs Dubbelman , Daan de Geus

Incorporation of prior knowledge about organ shape and location is key to improve performance of image analysis approaches. In particular, priors can be useful in cases where images are corrupted and contain artefacts due to limitations in…