English
Related papers

Related papers: Large-scale Multi-sequence Pretraining for General…

200 papers

Despite the considerable progress in automatic abdominal multi-organ segmentation from CT/MRI scans in recent years, a comprehensive evaluation of the models' capabilities is hampered by the lack of a large-scale benchmark from diverse…

Image and Video Processing · Electrical Eng. & Systems 2022-09-05 Yuanfeng Ji , Haotian Bai , Jie Yang , Chongjian Ge , Ye Zhu , Ruimao Zhang , Zhen Li , Lingyan Zhang , Wanling Ma , Xiang Wan , Ping Luo

Magnetic resonance imaging (MRI) is a vital diagnostic tool, but its inherently long acquisition times reduce clinical efficiency and patient comfort. Recent advancements in deep learning, particularly diffusion models, have improved…

Image and Video Processing · Electrical Eng. & Systems 2026-04-28 Yuxuan Zhang , Jinkui Hao , Bo Zhou

Clinical diagnostic workups typically follow a modality escalation pathway: after initial clinical evaluation, clinicians begin with routine structural imaging (e.g., MRI), selectively add sequences such as FLAIR or T2 to refine the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Guangqian Yang , Tong Ding , Wenlong Hou , Yue Xun , Ye Du , Qian Niu , Shujun Wang

Large Language Models (LLMs), constrained by their auto-regressive nature, suffer from slow decoding. Speculative decoding methods have emerged as a promising solution to accelerate LLM decoding, attracting attention from both systems and…

Artificial Intelligence · Computer Science 2026-02-03 Xuliang Wang , Yuetao Chen , Maochan Zhen , Fang Liu , Xinzhou Zheng , Xingwu Liu , Hong Xu , Ming Li

Pre-trained segmentation models are a powerful and flexible tool for segmenting images. Recently, this trend has extended to medical imaging. Yet, often these methods only produce a single prediction for a given image, neglecting inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Benjamin Towle , Xin Chen , Ke Zhou

Machine Learning (ML) is increasingly being used for computer aided diagnosis of brain related disorders based on structural magnetic resonance imaging (MRI) data. Most of such work employs biologically and medically meaningful hand-crafted…

Machine Learning · Computer Science 2018-05-04 Ayush Jaiswal , Dong Guo , Cauligi S. Raghavendra , Paul Thompson

Foundation models have achieved transformative success across biomedical domains by enabling holistic understanding of multimodal data. However, their application in surgery remains underexplored. Surgical intelligence presents unique…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zhitao Zeng , Zhu Zhuo , Xiaojun Jia , Erli Zhang , Junde Wu , Jiaan Zhang , Yuxuan Wang , Chang Han Low , Jian Jiang , Zilong Zheng , Xiaochun Cao , Yutong Ban , Qi Dou , Yang Liu , Yueming Jin

Registration of longitudinal brain MRI scans containing pathologies is challenging due to dramatic changes in tissue appearance. Although there has been progress in developing general-purpose medical image registration techniques, they have…

Magnetic resonance imaging (MRI) is a widely used radiological modality renowned for its radiation-free, comprehensive insights into the human body, facilitating medical diagnoses. However, the drawback of prolonged scan times hinders its…

Biomedical data is inherently multimodal, consisting of electronic health records, medical imaging, digital pathology, genome sequencing, wearable sensors, and more. The application of artificial intelligence tools to these multifaceted…

Machine Learning · Computer Science 2024-08-26 Shentong Mo , Paul Pu Liang

Automated interpretability research aims to identify concepts encoded in neural network features to enhance human understanding of model behavior. Within the context of large language models (LLMs) for natural language processing (NLP),…

Machine Learning · Computer Science 2025-11-13 Laura Kopf , Nils Feldhus , Kirill Bykov , Philine Lou Bommer , Anna Hedström , Marina M. -C. Höhne , Oliver Eberle

Artificial intelligence (AI) systems hold great promise to improve healthcare over the next decades. Specifically, AI systems leveraging multiple data sources and input modalities are poised to become a viable method to deliver more…

Vision-and-language multi-modal pretraining and fine-tuning have shown great success in visual question answering (VQA). Compared to general domain VQA, the performance of biomedical VQA suffers from limited data. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zheng Yuan , Qiao Jin , Chuanqi Tan , Zhengyun Zhao , Hongyi Yuan , Fei Huang , Songfang Huang

Multimodal learning, especially large-scale multimodal pre-training, has developed rapidly over the past few years and led to the greatest advances in artificial intelligence (AI). Despite its effectiveness, understanding the underlying…

Neural and Evolutionary Computing · Computer Science 2022-08-18 Haoyu Lu , Qiongyi Zhou , Nanyi Fei , Zhiwu Lu , Mingyu Ding , Jingyuan Wen , Changde Du , Xin Zhao , Hao Sun , Huiguang He , Ji-Rong Wen

Masked Image Modeling (MIM) has emerged as a powerful self-supervised learning paradigm for visual representation learning, enabling models to acquire rich visual representations by predicting masked portions of images from their visible…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Jinhong Lin , Cheng-En Wu , Huanran Li , Jifan Zhang , Yu Hen Hu , Pedro Morgado

Personalisation is a standard feature of conversational AI systems used by millions; yet, the efficacy of personalisation methods is often evaluated in academic research using simulated users rather than real people. This raises questions…

Computation and Language · Computer Science 2026-05-14 Hannah Rose Kirk , Liu Leqi , Fanzhi Zeng , Henry Davidson , Bertie Vidgen , Christopher Summerfield , Scott A. Hale

Clinical MRI frequently acquires anisotropic volumes with high in-plane resolution and low through-plane resolution to reduce acquisition time. Multiple orientations are therefore acquired to provide complementary anatomical information.…

Image and Video Processing · Electrical Eng. & Systems 2026-03-25 Heejong Kim , Abhishek Thanki , Roel van Herten , Daniel Margolis , Mert R Sabuncu

Large Vision-Language Models offer a new paradigm for AI-driven image understanding, enabling models to perform tasks without task-specific training. This flexibility holds particular promise across medicine, where expert-annotated data is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Anita Rau , Mark Endo , Josiah Aklilu , Jaewoo Heo , Khaled Saab , Alberto Paderno , Jeffrey Jopling , F. Christopher Holsinger , Serena Yeung-Levy

Deep learning models have become the dominant method for medical image segmentation. However, they often struggle to be generalisable to unknown tasks involving new anatomical structures, labels, or shapes. In these cases, the model needs…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Jing Xu

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Peirong Liu , Oula Puonti , Xiaoling Hu , Karthik Gopinath , Annabel Sorby-Adams , Daniel C. Alexander , W. Taylor Kimberly , Juan E. Iglesias