English
Related papers

Related papers: Path-RAG: Knowledge-Guided Key Region Retrieval fo…

200 papers

Multimodal large language models (MLLMs), such as GPT-4o, Gemini, LLaVA, and Flamingo, have made significant progress in integrating visual and textual modalities, excelling in tasks like visual question answering (VQA), image captioning,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Junxiao Xue , Quan Deng , Fei Yu , Yanhao Wang , Jun Wang , Yuehua Li

With the widespread application of electroencephalography (EEG) in neuroscience and clinical practice, efficiently retrieving and semantically interpreting large-scale, multi-source, heterogeneous EEG data has become a pressing challenge.…

Computation and Language · Computer Science 2025-10-14 Yi Wang , Haoran Luo , Lu Meng , Ziyu Jia , Xinliang Zhou , Qingsong Wen

Large Language Models (LLMs) often struggle with inherent knowledge boundaries and hallucinations, limiting their reliability in knowledge-intensive tasks. While Retrieval-Augmented Generation (RAG) mitigates these issues, it frequently…

Artificial Intelligence · Computer Science 2026-02-25 Yuqi Huang , Ning Liao , Kai Yang , Anning Hu , Shengchao Hu , Xiaoxing Wang , Junchi Yan

Knowledge-based Visual Question Answering (KVQA) tasks require answering questions about images using extensive background knowledge. Despite significant advancements, generative models often struggle with these tasks due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yibin Yan , Weidi Xie

Retrieval-augmented generation (RAG) is a well-suited technique for retrieving privacy-sensitive Electronic Health Records (EHR). It can serve as a key module of the healthcare copilot, helping reduce misdiagnosis for healthcare…

Computation and Language · Computer Science 2025-06-30 Xuejiao Zhao , Siyan Liu , Su-Yin Yang , Chunyan Miao

The combination of data analysis methods, increasing computing capacity, and improved sensors enable quantitative granular, multi-scale, cell-based analyses. We describe the rich set of application challenges related to tissue…

Artificial Intelligence · Computer Science 2022-06-16 Rajarsi Gupta , Jakub Kaczmarzyk , Soma Kobayashi , Tahsin Kurc , Joel Saltz

The complexity and variability inherent in high-resolution pathological images present significant challenges in computational pathology. While pathology foundation models leveraging AI have catalyzed transformative advancements, their…

Biomedical ontologies, which comprehensively define concepts and relations for biomedical entities, are crucial for structuring and formalizing domain-specific information representations. Biomedical code mapping identifies similarity or…

Information Retrieval · Computer Science 2025-02-27 Hui Feng , Yuntzu Yin , Emiliano Reynares , Jay Nanavati

Predicting spatial gene expression from H&E histology offers a scalable and clinically accessible alternative to sequencing, but realizing clinical impact requires models that generalize across cancer types and capture biologically coherent…

Machine Learning · Computer Science 2026-02-10 Susu Hu , Qinghe Zeng , Nithya Bhasker , Jakob Nikolas Kather , Stefanie Speidel

Diagnosing hepatic diseases accurately and interpretably is critical, yet it remains challenging in real-world clinical settings. Existing AI approaches for clinical diagnosis often lack transparency, structured reasoning, and…

Artificial Intelligence · Computer Science 2026-03-06 Zheng Li , Jiayi Xu , Zhikai Hu , Hechang Chen , Lele Cong , Yunyun Wang , Shuchao Pang

Transcriptomic assays such as the PAM50-based ROR-P score guide recurrence risk stratification in non-metastatic, ER-positive, HER2-negative breast cancer but are not universally accessible. Histopathology is routinely available and may…

Deep learning models have shown immense promise in computational pathology (CPath) tasks, but their performance often suffers when applied to unseen data due to domain shifts. Addressing this requires domain generalization (DG) algorithms.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Neda Zamanitajeddin , Mostafa Jahanifar , Kesi Xu , Fouzia Siraj , Nasir Rajpoot

Deciphering tumor microenvironment from Whole Slide Images (WSIs) is intriguing as it is key to cancer diagnosis, prognosis and treatment response. While these gigapixel images on one hand offer a comprehensive portrait of cancer, on the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Kunpeng Zhang , Hanwen Xu , Sheng Wang

Magnetic resonance imaging (MRI) is an increasingly important tool for the diagnosis and treatment of prostate cancer. However, interpretation of MRI suffers from high inter-observer variability across radiologists, thereby contributing to…

In the cancer diagnosis pipeline, digital pathology plays an instrumental role in the identification, staging, and grading of malignant areas on biopsy tissue specimens. High resolution histology images are subject to high variance in…

Image and Video Processing · Electrical Eng. & Systems 2023-08-17 Vasileios Magoulianitis , Catherine A. Alexander , C. -C. Jay Kuo

Diffusion models enable high-quality and diverse visual content synthesis. However, they struggle to generate rare or unseen concepts. To address this challenge, we explore the usage of Retrieval-Augmented Generation (RAG) with image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Rotem Shalev-Arkushin , Rinon Gal , Amit H. Bermano , Ohad Fried

This work presents a Biomedical Literature Question Answering (Q&A) system based on a Retrieval-Augmented Generation (RAG) architecture, designed to improve access to accurate, evidence-based medical information. Addressing the shortcomings…

Computation and Language · Computer Science 2025-09-09 Mansi Garg , Lee-Chi Wang , Bhavesh Ghanchi , Sanjana Dumpala , Shreyash Kakde , Yen Chih Chen

Retrieval-augmented generation (RAG) has emerged as a promising technology for addressing hallucination issues in the responses generated by large language models (LLMs). Existing studies on RAG primarily focus on applying semantic-based…

Computation and Language · Computer Science 2025-02-12 Xiangrong Zhu , Yuexiang Xie , Yi Liu , Yaliang Li , Wei Hu

Recent proprietary large language models (LLMs), such as GPT-4, have achieved a milestone in tackling diverse challenges in the biomedical domain, ranging from multiple-choice questions to long-form generations. To address challenges that…

Computation and Language · Computer Science 2024-06-19 Minbyul Jeong , Jiwoong Sohn , Mujeen Sung , Jaewoo Kang

Gene expression can be used to subtype breast cancer with improved prediction of risk of recurrence and treatment responsiveness over that obtained using routine immunohistochemistry (IHC). However, in the clinic, molecular profiling is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Raktim Kumar Mondol , Ewan K. A. Millar , Peter H Graham , Lois Browne , Arcot Sowmya , Erik Meijering