English
Related papers

Related papers: LLaMA-Reg: Using LLaMA 2 for Unsupervised Medical …

200 papers

Longitudinal image registration is challenging and has not yet benefited from major performance improvements thanks to deep-learning. Inspired by Deep Image Prior, this paper introduces a different use of deep architectures as regularizers…

We propose TG-LMM (Text-Guided Large Multi-Modal Model), a novel approach that leverages textual descriptions of organs to enhance segmentation accuracy in medical images. Existing medical image segmentation methods face several challenges:…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Yihao Zhao , Enhao Zhong , Cuiyun Yuan , Yang Li , Man Zhao , Chunxia Li , Jun Hu , Chenbin Liu

Large language models (LLMs) significantly enhance the performance of various applications, but they are computationally intensive and energy-demanding. This makes it challenging to deploy them on devices with limited resources, such as…

Machine Learning · Computer Science 2025-12-22 Yang Li , Daniel Agyei Asante , Changsheng Zhao , Ernie Chang , Yangyang Shi , Vikas Chandra

Registration is a fundamental task in medical robotics and is often a crucial step for many downstream tasks such as motion analysis, intra-operative tracking and image segmentation. Popular registration methods such as ANTs and NiftyReg…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Wentao Zhu , Yufang Huang , Daguang Xu , Zhen Qian , Wei Fan , Xiaohui Xie

Medical caption prediction which can be regarded as a task of medical report generation (MRG), requires the automatic generation of coherent and accurate captions for the given medical images. However, the scarcity of labelled medical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Bang Yang , Asif Raza , Yuexian Zou , Tong Zhang

Deformable medical image registration is an essential task in computer-assisted interventions. This problem is particularly relevant to oncological treatments, where precise image alignment is necessary for tracking tumor growth, assessing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Stefano Fogarollo , Gregor Laimer , Reto Bale , Matthias Harders

In current biological and medical research, statistical shape modeling (SSM) provides an essential framework for the characterization of anatomy/morphology. Such analysis is often driven by the identification of a relatively small number of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Riddhish Bhalodia , Shireen Elhabian , Ladislav Kavan , Ross Whitaker

Recent advances in deep learning-based medical image registration have shown that training deep neural networks~(DNNs) does not necessarily require medical images. Previous work showed that DNNs trained on randomly generated images with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Junyu Chen , Shuwen Wei , Yihao Liu , Aaron Carass , Yong Du

Images in the medical domain are fundamentally different from the general domain images. Consequently, it is infeasible to directly employ general domain Visual Question Answering (VQA) models for the medical domain. Additionally, medical…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yash Khare , Viraj Bagal , Minesh Mathew , Adithi Devi , U Deva Priyakumar , CV Jawahar

This document outlines a tutorial to get started with medical image registration using the open-source package DeepReg. The basic concepts of medical image registration are discussed, linking classical methods to newer methods using deep…

Image and Video Processing · Electrical Eng. & Systems 2020-09-08 N. Montana Brown , Y. Fu , S. U. Saeed , A. Casamitjana , Z. M. C. Baum , R. Delaunay , Q. Yang , A. Grimwood , Z. Min , E. Bonmati , T. Vercauteren , M. J. Clarkson , Y. Hu

Medical image registration is vital for disease diagnosis and treatment with its ability to merge diverse information of images, which may be captured under different times, angles, or modalities. Although several surveys have reviewed the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Qiushi Nie , Xiaoqing Zhang , Yan Hu , Mingdao Gong , Jiang Liu

We introduce a deep encoder-decoder architecture for image deformation prediction from multimodal images. Specifically, we design an image-patch-based deep network that jointly (i) learns an image similarity measure and (ii) the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Xiao Yang , Roland Kwitt , Martin Styner , Marc Niethammer

We propose a fluid-based registration framework of medical images based on implicit neural representation. By integrating implicit neural representation and Large Deformable Diffeomorphic Metric Mapping (LDDMM), we employ a Multilayer…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Chulong Zhang , Xiaokun Liang

In recent years, pre-trained large language models (LLMs) have achieved tremendous success in the field of Natural Language Processing (NLP). Prior studies have primarily focused on general and generic domains, with relatively less research…

Large Language Models (LLMs) have demonstrated remarkable performance across various domains, including healthcare. However, their ability to effectively represent structured non-textual data, such as the alphanumeric medical codes used in…

Deformable image registration is a fundamental task in medical image analysis and plays a crucial role in a wide range of clinical applications. Recently, deep learning-based approaches have been widely studied for deformable medical image…

Image and Video Processing · Electrical Eng. & Systems 2023-07-03 Jing Zou , Noémie Debroux , Lihao Liu , Jing Qin , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

Decoding non-invasive brain recordings is pivotal for advancing our understanding of human cognition but faces challenges due to individual differences and complex neural signal representations. Traditional methods often require customized…

Neural and Evolutionary Computing · Computer Science 2024-10-15 Guobin Shen , Dongcheng Zhao , Xiang He , Linghao Feng , Yiting Dong , Jihang Wang , Qian Zhang , Yi Zeng

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers to learn features…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jiong Wu , Kuang Gong

Existing Medical Large Vision-Language Models (Med-LVLMs), encapsulating extensive medical knowledge, demonstrate excellent capabilities in understanding medical images. However, there remain challenges in visual localization in medical…

Computation and Language · Computer Science 2025-06-03 Yucheng Zhou , Lingran Song , Jianbing Shen

Surgical navigation based on multimodal image registration has played a significant role in providing intraoperative guidance to surgeons by showing the relative position of the target area to critical anatomical structures during surgery.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Jiazheng Wang , Xiang Chen , Yuxi Zhang , Min Liu , Yaonan Wang , Hang Zhang