English
Related papers

Related papers: Semantic-Topological Graph Reasoning for Language-…

200 papers

Computed tomography (CT) report generation is crucial to assist radiologists in interpreting CT volumes, which can be time-consuming and labor-intensive. Existing methods primarily only consider the global features of the entire volume,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Zhixuan Chen , Yequan Bie , Haibo Jin , Hao Chen

Recent progress in medical vision-language models (VLMs) has achieved strong performance on image-level text-centric tasks such as report generation and visual question answering (VQA). However, achieving fine-grained visual grounding and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Yang Xing , Jiong Wu , Savas Ozdemir , Ying Zhang , Yang Yang , Wei Shao , Kuang Gong

Large language models (LLMs), including zero-shot and few-shot paradigms, have shown promising capabilities in clinical text generation. However, real-world applications face two key challenges: (1) patient data is highly unstructured,…

Computation and Language · Computer Science 2025-07-10 Garapati Keerthana , Manik Gupta

Schema matching is a critical task in data integration, particularly in the medical domain where disparate Electronic Health Record (EHR) systems must be aligned to standard models like OMOP CDM. While Large Language Models (LLMs) have…

Artificial Intelligence · Computer Science 2025-12-02 Mingyu Jeon , Jaeyoung Suh , Suwan Cho

Purpose: Interpreting chest radiographs (CXR) remains challenging due to the ambiguity of overlapping structures such as the lungs, heart, and bones. To address this issue, we propose a novel method for extracting fine-grained anatomical…

Image and Video Processing · Electrical Eng. & Systems 2023-06-08 Constantin Seibold , Alexander Jaus , Matthias A. Fink , Moon Kim , Simon Reiß , Ken Herrmann , Jens Kleesiek , Rainer Stiefelhagen

Computed tomography (CT) is extensively used for accurate visualization and segmentation of organs and lesions. While deep learning models such as convolutional neural networks (CNNs) and vision transformers (ViTs) have significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuheng Li , Yuxiang Lai , Maria Thor , Deborah Marshall , Zachary Buchwald , David S. Yu , Xiaofeng Yang

Clinical decision support using deep neural networks has become a topic of steadily growing interest. While recent work has repeatedly demonstrated that deep learning offers major advantages for medical image classification over traditional…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Alexander Katzmann , Oliver Taubmann , Stephen Ahmad , Alexander Mühlberg , Michael Sühling , Horst-Michael Groß

Establishing dense correspondence across 3D shapes is crucial for fundamental downstream tasks, including texture transfer, shape interpolation, and robotic manipulation. However, learning these mappings without manual supervision remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qinfeng Xiao , Guofeng Mei , Qilong Liu , Chenyuan Yi , Fabio Poiesi , Jian Zhang , Bo Yang , Yick Kit-lun

Accurate prediction of treatment outcomes in lung cancer remains challenging due to the sparsity, heterogeneity, and contextual overload of real-world electronic health data. Traditional models often fail to capture semantic information…

Graph Retrieval-Augmented Generation (GRAG or Graph RAG) architectures aim to enhance language understanding and generation by leveraging external knowledge. However, effectively capturing and integrating the rich semantic information…

Computation and Language · Computer Science 2025-01-29 Karishma Thakrar

Vision-Language Pretraining (VLP) has demonstrated remarkable capabilities in learning visual representations from textual descriptions of images without annotations. Yet, effective VLP demands large-scale image-text pairs, a resource that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Yinda Chen , Che Liu , Wei Huang , Sibo Cheng , Rossella Arcucci , Zhiwei Xiong

We introduce Med-CTX, a fully transformer based multimodal framework for explainable breast cancer ultrasound segmentation. We integrate clinical radiology reports to boost both performance and interpretability. Med-CTX achieves exact…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Enobong Adahada , Isabel Sassoon , Kate Hone , Yongmin Li

Accurate segmentation is essential for echocardiography-based assessment of cardiovascular diseases (CVDs). However, the variability among sonographers and the inherent challenges of ultrasound images hinder precise segmentation. By…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Rabin Adhikari , Manish Dhakal , Safal Thapaliya , Kanchan Poudel , Prasiddha Bhandari , Bishesh Khanal

The Vision Foundation Model has recently gained attention in medical image analysis. Its zero-shot learning capabilities accelerate AI deployment and enhance the generalizability of clinical applications. However, segmenting pathological…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Can Cui , Ruining Deng , Junlin Guo , Quan Liu , Tianyuan Yao , Haichun Yang , Yuankai Huo

Vision--language models (VLMs) for radiology report generation (RRG) can produce long-form chest CT reports from volumetric scans and show strong potential to improve radiology workflow efficiency and consistency. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chenyu Wang , Weicheng Dai , Han Liu , Wenchao Li , Kayhan Batmanghelich

Semantic parsing is the task of producing a structured meaning representation for natural language utterances or questions. Recent research has pointed out that the commonly-used sequence-to-sequence (seq2seq) semantic parsers struggle to…

Computation and Language · Computer Science 2022-06-06 Dora Jambor , Dzmitry Bahdanau

Integrating heterogeneous biomedical data including imaging, omics, and clinical records supports accurate diagnosis and personalised care. Graph-based models fuse such non-Euclidean data by capturing spatial and relational structure, yet…

Genomics · Quantitative Biology 2025-05-06 Alireza Sadeghi , Farshid Hajati , Ahmadreza Argha , Nigel H Lovell , Min Yang , Hamid Alinejad-Rokny

Significant efforts have been dedicated to integrating the powerful Large Language Models (LLMs) with diverse modalities, particularly focusing on the fusion of language, vision and audio data. However, the graph-structured data, which is…

Computation and Language · Computer Science 2024-12-31 Zipeng Liu , Likang Wu , Ming He , Zhong Guan , Hongke Zhao , Nan Feng

Developing 3D vision-language models with robust clinical reasoning remains a challenge due to the inherent complexity of volumetric medical imaging, the tendency of models to overfit superficial report patterns, and the lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Haoran Lai , Zihang Jiang , Kun Zhang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Wei Wei , Shaohua Kevin Zhou

Visual Place Recognition (VPR) in long-term deployment requires reasoning beyond pixel similarity: systems must make transparent, interpretable decisions that remain robust under lighting, weather and seasonal change. We present Text2Graph…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Saeideh Yousefzadeh , Hamidreza Pourreza