English
Related papers

Related papers: Graph-Augmented Topological Internalization with D…

200 papers

Drafting radiology reports is a complex task requiring flexibility, where radiologists tail content to available information and particular clinical demands. However, most current radiology report generation (RRG) models are constrained to…

Computation and Language · Computer Science 2024-12-17 Zhuhao Wang , Yihua Sun , Zihan Li , Xuan Yang , Fang Chen , Hongen Liao

In large population-based studies and in clinical routine, tasks like disease diagnosis and progression prediction are inherently based on a rich set of multi-modal data, including imaging and other sensor data, clinical scores, phenotypes,…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Gerome Vivar , Andreas Zwergal , Nassir Navab , Seyed-Ahmad Ahmadi

Integrating multi-omics data, such as DNA methylation, mRNA expression, and microRNA (miRNA) expression, offers a comprehensive view of the biological mechanisms underlying disease. However, the high dimensionality of multi-omics data, the…

Machine Learning · Computer Science 2026-02-12 Tiantian Yang , Zhiqian Chen

In clinical practice, human radiologists actually review medical images with high resolution monitors and zoom into region of interests (ROIs) for a close-up examination. Inspired by this observation, we propose a hierarchical graph neural…

Image and Video Processing · Electrical Eng. & Systems 2019-12-17 Hao Du , Jiashi Feng , Mengling Feng

Real-world heterogeneous graphs are inherently noisy and usually not in the optimal graph structures for downstream tasks, which often adversely affects the performance of GRL models in downstream tasks. Although Graph Structure Learning…

Machine Learning · Computer Science 2026-04-08 He Zhao , Zhiwei Zeng , Yongwei Wang , Chunyan Miao

Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Deep generative models have significantly advanced medical imaging analysis by enhancing dataset size and quality. Beyond mere data augmentation, our research in this paper highlights an additional, significant capacity of deep generative…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Xiaodan Xing , Junzhi Ning , Yang Nan , Guang Yang

Medical imaging is widely used in clinical practice for diagnosis and treatment. Report-writing can be error-prone for unexperienced physicians, and time- consuming and tedious for experienced physicians. To address these issues, we study…

Computation and Language · Computer Science 2019-01-09 Baoyu Jing , Pengtao Xie , Eric Xing

Graphs are a powerful tool for representing and analyzing unstructured, non-Euclidean data ubiquitous in the healthcare domain. Two prominent examples are molecule property prediction and brain connectome analysis. Importantly, recent works…

Machine Learning · Computer Science 2022-04-04 Kamilia Mullakaeva , Luca Cosmo , Anees Kazi , Seyed-Ahmad Ahmadi , Nassir Navab , Michael M. Bronstein

Integrating multi-omics datasets through data-driven analysis offers a comprehensive understanding of the complex biological processes underlying various diseases, particularly cancer. Graph Neural Networks (GNNs) have recently demonstrated…

Machine Learning · Computer Science 2025-08-11 Jielong Lu , Zhihao Wu , Jiajun Yu , Jiajun Bu , Haishuai Wang

Deep learning-based computer-aided diagnosis is gradually deployed to review and analyze medical images. However, this paradigm is restricted in real-world clinical applications due to the poor robustness and generalization. The issue is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yurong Chen

Large Language Models (LLMs) often suffer from hallucinations, which Retrieval-Augmented Generation (RAG) and GraphRAG mitigate by incorporating external knowledge and knowledge graphs (KGs). However, GraphRAG remains text-centric due to…

Artificial Intelligence · Computer Science 2026-03-11 Xueyao Wan , Hang Yu

Knowledge Graphs (KGs) have proven highly effective for recommendation systems by capturing latent item relationships, while recent integration of Large Language Models (LLMs) has further enhanced semantic understanding and addressed…

Information Retrieval · Computer Science 2026-05-11 Xinchi Zou , Tongzhenzhi Su , Jianjun Li , Yuan Fu , Chang Liu , Zhiying Deng , Zhiwei Shen

Network topology excels at structural predictions but fails to capture functional semantics encoded in biomedical literature. We present RAG-GNN, an end-to-end trainable retrieval-augmented graph neural network framework that integrates GNN…

Molecular Networks · Quantitative Biology 2026-05-14 Hasi Hays , William J. Richardson

Medical Dialogue Generation serves a critical role in telemedicine by facilitating the dissemination of medical expertise to patients. Existing studies focus on incorporating textual representations, which have limited their ability to…

Computation and Language · Computer Science 2023-09-20 Bohao Yang , Chen Tang , Chenghua Lin

In the field of multimodal medical data analysis, leveraging diverse types of data and understanding their hidden relationships continues to be a research focus. The main challenges lie in effectively modeling the complex interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xuhao Shan , Ruiquan Ge , Jikui Liu , Linglong Wu , Chi Zhang , Siqi Liu , Wenjian Qin , Wenwen Min , Ahmed Elazab , Changmiao Wang

Recent advancements in Large Language Models (LLMs) have demonstrated significant promise in clinical diagnosis. However, current models struggle to emulate the iterative, diagnostic hypothesis-driven reasoning of real clinical scenarios.…

Computation and Language · Computer Science 2026-01-06 Qipeng Wang , Rui Sheng , Yafei Li , Huamin Qu , Yushi Sun , Min Zhu

The automatic generation of radiology reports given medical radiographs has significant potential to operationally and improve clinical patient care. A number of prior works have focused on this problem, employing advanced methods from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Guanxiong Liu , Tzu-Ming Harry Hsu , Matthew McDermott , Willie Boag , Wei-Hung Weng , Peter Szolovits , Marzyeh Ghassemi

Graph Retrieval-Augmented Generation (GraphRAG) enhances factual reasoning in LLMs by structurally modeling knowledge through graph-based representations. However, existing GraphRAG approaches face two core limitations: shallow retrieval…

Computation and Language · Computer Science 2025-10-01 Cehao Yang , Xiaojun Wu , Xueyuan Lin , Chengjin Xu , Xuhui Jiang , Yuanliang Sun , Jia Li , Hui Xiong , Jian Guo

Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates the risk of human error, potentially leading to treatment…

Image and Video Processing · Electrical Eng. & Systems 2024-07-31 Jiayu Lei , Xiaoman Zhang , Chaoyi Wu , Lisong Dai , Ya Zhang , Yanyong Zhang , Yanfeng Wang , Weidi Xie , Yuehua Li