中文
相关论文

相关论文: Vision-Language Models for Automated 3D PET/CT Rep…

200 篇论文

This paper introduces an approach that combines the language reasoning capabilities of large language models (LLMs) with the benefits of local training to tackle complex, domain-specific tasks. Specifically, the authors demonstrate their…

计算与语言 · 计算机科学 2023-08-04 V. K. Cody Bumgardner , Aaron Mullen , Sam Armstrong , Caylin Hickey , Jeff Talbert

$\textbf{Purpose}$: Automatic quantification of longitudinal changes in PET scans for lymphoma patients has proven challenging, as residual disease in interim-therapy scans is often subtle and difficult to detect. Our goal was to develop a…

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

计算与语言 · 计算机科学 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

In the pursuit of efficient automated content creation, procedural generation, leveraging modifiable parameters and rule-based systems, emerges as a promising approach. Nonetheless, it could be a demanding endeavor, given its intricate…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Chunyi Sun , Junlin Han , Weijian Deng , Xinlong Wang , Zishan Qin , Stephen Gould

Radiology report generation aims to automatically provide clinically meaningful descriptions of radiology images such as MRI and X-ray. Although great success has been achieved in natural scene image captioning tasks, radiology report…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Jun Wang , Lixing Zhu , Abhir Bhalerao , Yulan He

Pathology image segmentation is crucial in computational pathology for analyzing histological features relevant to cancer diagnosis and prognosis. However, current methods face major challenges in clinical applications due to limited…

计算机视觉与模式识别 · 计算机科学 2025-08-20 Zhixuan Chen , Junlin Hou , Liqi Lin , Yihui Wang , Yequan Bie , Xi Wang , Yanning Zhou , Ronald Cheong Kin Chan , Hao Chen

Proteins adopt multiple structural conformations to perform their diverse biological functions, and understanding these conformations is crucial for advancing drug discovery. Traditional physics-based simulation methods often struggle with…

生物大分子 · 定量生物学 2025-03-14 Jiarui Lu , Xiaoyin Chen , Stephen Zhewen Lu , Chence Shi , Hongyu Guo , Yoshua Bengio , Jian Tang

General-purpose vision-language models (VLMs) have emerged as promising tools in radiology, offering zero-shot capabilities that mitigate the need for large labeled datasets. However, in high-stakes domains like diagnostic radiology, these…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Hao-Chih Lee , Zelong Liu , Hamza Ahmed , Spencer Kim , Sean Huver , Vishwesh Nath , Zahi A. Fayad , Timothy Deyer , Xueyan Mei

Tumor lesion segmentation is one of the most important tasks in medical image analysis. In clinical practice, Fluorodeoxyglucose Positron-Emission Tomography~(FDG-PET) is a widely used technique to identify and quantify metabolically active…

图像与视频处理 · 电气工程与系统科学 2022-10-17 Jin Ye , Haoyu Wang , Ziyan Huang , Zhongying Deng , Yanzhou Su , Can Tu , Qian Wu , Yuncheng Yang , Meng Wei , Jingqi Niu , Junjun He

Numerous oncology indications have extensively quantified metabolically active tumors using positron emission tomography (PET) and computed tomography (CT). F-fluorodeoxyglucose-positron emission tomography (FDG-PET) is frequently utilized…

图像与视频处理 · 电气工程与系统科学 2022-10-17 Sepideh Amiri , Bulat Ibragimov

Medical imaging is an essential tool for diagnosing various healthcare diseases and conditions. However, analyzing medical images is a complex and time-consuming task that requires expertise and experience. This article aims to design a…

图像与视频处理 · 电气工程与系统科学 2023-05-15 Ayyub Alzahem , Shahid Latif , Wadii Boulila , Anis Koubaa

Automatic generation of ophthalmic reports using data-driven neural networks has great potential in clinical practice. When writing a report, ophthalmologists make inferences with prior clinical knowledge. This knowledge has been neglected…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Mingjie Li , Wenjia Cai , Karin Verspoor , Shirui Pan , Xiaodan Liang , Xiaojun Chang

Automatic segmentation of tumor lesions is a critical initial processing step for quantitative PET/CT analysis. However, numerous tumor lesion with different shapes, sizes, and uptake intensity may be distributed in different anatomical…

图像与视频处理 · 电气工程与系统科学 2022-09-07 Shaonan Zhong , Junyang Mo , Zhantao Liu

Spoken communication plays a central role in clinical workflows. In radiology, for example, most reports are created through dictation. Yet, nearly all medical AI systems rely exclusively on written text. In this work, we address this gap…

Large language models (LLMs) are increasingly recognized as valuable tools across the medical environment, supporting clinical, research, and administrative workflows. However, strict privacy and network security regulations in hospital…

计算与语言 · 计算机科学 2026-01-09 Seokhwan Ko , Donghyeon Lee , Jaewoo Chun , Hyungsoo Han , Junghwan Cho

Segment anything model (SAM) demonstrates strong generalization ability on natural image segmentation. However, its direct adaptation in medical image segmentation tasks shows significant performance drops. It also requires an excessive…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Heng Guo , Jianfeng Zhang , Jiaxing Huang , Tony C. W. Mok , Dazhou Guo , Ke Yan , Le Lu , Dakai Jin , Minfeng Xu

Multimodal Empathetic Response Generation (MERG) is crucial for building emotionally intelligent human-computer interactions. Although large language models (LLMs) have improved text-based ERG, challenges remain in handling multimodal…

人工智能 · 计算机科学 2025-08-19 Ronghao Lin , Shuai Shen , Weipeng Hu , Qiaolin He , Aolin Xiong , Li Huang , Haifeng Hu , Yap-peng Tan

Recent advances in Large Vision-Language Models (LVLMs) have shown strong potential for multi-modal radiological reasoning, particularly in tasks like diagnostic visual question answering (VQA) and radiology report generation. However, most…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Yannian Gu , Xizhuo Zhang , Linjie Mu , Yongrui Yu , Zhongzhen Huang , Shaoting Zhang , Xiaofan Zhang

Vision-Language Pretraining (VLP) has demonstrated remarkable capabilities in learning visual representations from textual descriptions of images without annotations. Yet, effective VLP demands large-scale image-text pairs, a resource that…

计算机视觉与模式识别 · 计算机科学 2023-06-09 Yinda Chen , Che Liu , Wei Huang , Sibo Cheng , Rossella Arcucci , Zhiwei Xiong

Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates the risk of human error, potentially leading to treatment…

图像与视频处理 · 电气工程与系统科学 2024-07-31 Jiayu Lei , Xiaoman Zhang , Chaoyi Wu , Lisong Dai , Ya Zhang , Yanyong Zhang , Yanfeng Wang , Weidi Xie , Yuehua Li