English
Related papers

Related papers: Vision-Language Models for Automated 3D PET/CT Rep…

200 papers

This paper introduces an approach that combines the language reasoning capabilities of large language models (LLMs) with the benefits of local training to tackle complex, domain-specific tasks. Specifically, the authors demonstrate their…

Computation and Language · Computer Science 2023-08-04 V. K. Cody Bumgardner , Aaron Mullen , Sam Armstrong , Caylin Hickey , Jeff Talbert

$\textbf{Purpose}$: Automatic quantification of longitudinal changes in PET scans for lymphoma patients has proven challenging, as residual disease in interim-therapy scans is often subtle and difficult to detect. Our goal was to develop a…

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

In the pursuit of efficient automated content creation, procedural generation, leveraging modifiable parameters and rule-based systems, emerges as a promising approach. Nonetheless, it could be a demanding endeavor, given its intricate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Chunyi Sun , Junlin Han , Weijian Deng , Xinlong Wang , Zishan Qin , Stephen Gould

Radiology report generation aims to automatically provide clinically meaningful descriptions of radiology images such as MRI and X-ray. Although great success has been achieved in natural scene image captioning tasks, radiology report…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Jun Wang , Lixing Zhu , Abhir Bhalerao , Yulan He

Pathology image segmentation is crucial in computational pathology for analyzing histological features relevant to cancer diagnosis and prognosis. However, current methods face major challenges in clinical applications due to limited…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Zhixuan Chen , Junlin Hou , Liqi Lin , Yihui Wang , Yequan Bie , Xi Wang , Yanning Zhou , Ronald Cheong Kin Chan , Hao Chen

Proteins adopt multiple structural conformations to perform their diverse biological functions, and understanding these conformations is crucial for advancing drug discovery. Traditional physics-based simulation methods often struggle with…

Biomolecules · Quantitative Biology 2025-03-14 Jiarui Lu , Xiaoyin Chen , Stephen Zhewen Lu , Chence Shi , Hongyu Guo , Yoshua Bengio , Jian Tang

General-purpose vision-language models (VLMs) have emerged as promising tools in radiology, offering zero-shot capabilities that mitigate the need for large labeled datasets. However, in high-stakes domains like diagnostic radiology, these…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Hao-Chih Lee , Zelong Liu , Hamza Ahmed , Spencer Kim , Sean Huver , Vishwesh Nath , Zahi A. Fayad , Timothy Deyer , Xueyan Mei

Tumor lesion segmentation is one of the most important tasks in medical image analysis. In clinical practice, Fluorodeoxyglucose Positron-Emission Tomography~(FDG-PET) is a widely used technique to identify and quantify metabolically active…

Image and Video Processing · Electrical Eng. & Systems 2022-10-17 Jin Ye , Haoyu Wang , Ziyan Huang , Zhongying Deng , Yanzhou Su , Can Tu , Qian Wu , Yuncheng Yang , Meng Wei , Jingqi Niu , Junjun He

Numerous oncology indications have extensively quantified metabolically active tumors using positron emission tomography (PET) and computed tomography (CT). F-fluorodeoxyglucose-positron emission tomography (FDG-PET) is frequently utilized…

Image and Video Processing · Electrical Eng. & Systems 2022-10-17 Sepideh Amiri , Bulat Ibragimov

Medical imaging is an essential tool for diagnosing various healthcare diseases and conditions. However, analyzing medical images is a complex and time-consuming task that requires expertise and experience. This article aims to design a…

Image and Video Processing · Electrical Eng. & Systems 2023-05-15 Ayyub Alzahem , Shahid Latif , Wadii Boulila , Anis Koubaa

Automatic generation of ophthalmic reports using data-driven neural networks has great potential in clinical practice. When writing a report, ophthalmologists make inferences with prior clinical knowledge. This knowledge has been neglected…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Mingjie Li , Wenjia Cai , Karin Verspoor , Shirui Pan , Xiaodan Liang , Xiaojun Chang

Automatic segmentation of tumor lesions is a critical initial processing step for quantitative PET/CT analysis. However, numerous tumor lesion with different shapes, sizes, and uptake intensity may be distributed in different anatomical…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Shaonan Zhong , Junyang Mo , Zhantao Liu

Spoken communication plays a central role in clinical workflows. In radiology, for example, most reports are created through dictation. Yet, nearly all medical AI systems rely exclusively on written text. In this work, we address this gap…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-06 Lukas Buess , Jan Geier , David Bani-Harouni , Chantal Pellegrini , Matthias Keicher , Paula Andrea Perez-Toro , Nassir Navab , Andreas Maier , Tomas Arias-Vergara

Large language models (LLMs) are increasingly recognized as valuable tools across the medical environment, supporting clinical, research, and administrative workflows. However, strict privacy and network security regulations in hospital…

Computation and Language · Computer Science 2026-01-09 Seokhwan Ko , Donghyeon Lee , Jaewoo Chun , Hyungsoo Han , Junghwan Cho

Segment anything model (SAM) demonstrates strong generalization ability on natural image segmentation. However, its direct adaptation in medical image segmentation tasks shows significant performance drops. It also requires an excessive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Heng Guo , Jianfeng Zhang , Jiaxing Huang , Tony C. W. Mok , Dazhou Guo , Ke Yan , Le Lu , Dakai Jin , Minfeng Xu

Multimodal Empathetic Response Generation (MERG) is crucial for building emotionally intelligent human-computer interactions. Although large language models (LLMs) have improved text-based ERG, challenges remain in handling multimodal…

Artificial Intelligence · Computer Science 2025-08-19 Ronghao Lin , Shuai Shen , Weipeng Hu , Qiaolin He , Aolin Xiong , Li Huang , Haifeng Hu , Yap-peng Tan

Recent advances in Large Vision-Language Models (LVLMs) have shown strong potential for multi-modal radiological reasoning, particularly in tasks like diagnostic visual question answering (VQA) and radiology report generation. However, most…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yannian Gu , Xizhuo Zhang , Linjie Mu , Yongrui Yu , Zhongzhen Huang , Shaoting Zhang , Xiaofan Zhang

Vision-Language Pretraining (VLP) has demonstrated remarkable capabilities in learning visual representations from textual descriptions of images without annotations. Yet, effective VLP demands large-scale image-text pairs, a resource that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Yinda Chen , Che Liu , Wei Huang , Sibo Cheng , Rossella Arcucci , Zhiwei Xiong

Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates the risk of human error, potentially leading to treatment…

Image and Video Processing · Electrical Eng. & Systems 2024-07-31 Jiayu Lei , Xiaoman Zhang , Chaoyi Wu , Lisong Dai , Ya Zhang , Yanyong Zhang , Yanfeng Wang , Weidi Xie , Yuehua Li