English
Related papers

Related papers: RAG4Outcome: A Retrieval-Augmented Multimodal Fram…

200 papers

Retrieval-augmented generation (RAG) improves large language model reliability by grounding generated responses in external evidence. However, RAG performance depends on the relevance of retrieved passages, the quality of evidence ranking,…

Information Retrieval · Computer Science 2026-05-05 Fariba Afrin Irany , Sampson Akwafuo

Retrieval-Augmented Generation (RAG) has become a standard architectural pattern for incorporating domain-specific knowledge into user-facing chat applications powered by Large Language Models (LLMs). RAG systems are characterized by (1) a…

Computation and Language · Computer Science 2025-01-17 Robert Friel , Masha Belyi , Atindriyo Sanyal

Retrieval-Augmented Generation (RAG) has emerged as a widely adopted approach for enhancing LLMs in scenarios that demand extensive factual knowledge. However, current RAG evaluations concentrate primarily on correctness, which may not…

Computation and Language · Computer Science 2026-03-23 Vinh Nguyen , Cuong Dang , Jiahao Zhang , Hoa Tran , Minh Tran , Trinh Chau , Thai Le , Lu Cheng , Suhang Wang

Reconstructing precise clinical timelines is essential for modeling patient trajectories and forecasting risk in complex, heterogeneous conditions like sepsis. While unstructured clinical narratives offer semantically rich and contextually…

Computation and Language · Computer Science 2026-05-15 Sayantan Kumar , Shahriar Noroozizadeh , Juyong Kim , Jeremy C. Weiss

Retrieval-Augmented Generation (RAG) systems for biomedical literature are typically evaluated using ranking metrics like Mean Reciprocal Rank (MRR), which measure how well the system identifies the single most relevant chunk. We argue that…

Artificial Intelligence · Computer Science 2026-03-25 Pouria Mortezaagha , Arya Rahgozar

Clinical outcome prediction plays an important role in stroke patient management. From a machine learning point-of-view, one of the main challenges is dealing with heterogeneous data at patient admission, i.e. the image data which are…

Image and Video Processing · Electrical Eng. & Systems 2022-05-12 Nima Hatami , Tae-Hee Cho , Laura Mechtouff , Omer Faruk Eker , David Rousseau , Carole Frindel

Evaluating automatically generated radiology reports remains a fundamental challenge due to the lack of clinically grounded, interpretable, and fine-grained metrics. Existing methods either produce coarse overall scores or rely on opaque…

Computation and Language · Computer Science 2025-08-22 Yingshu Li , Yunyi Liu , Lingqiao Liu , Lei Wang , Luping Zhou

Retrieval-Augmented Generation (RAG) technology has been widely applied in recent years. However, despite the emergence of various RAG frameworks, a single RAG framework still cannot adapt well to a broad range of downstream tasks.…

Artificial Intelligence · Computer Science 2025-08-20 Yifei Chen , Guanting Dong , Yutao Zhu , Zhicheng Dou

The integration of multimodal Electronic Health Records (EHR) data has significantly advanced clinical predictive capabilities. Existing models, which utilize clinical notes and multivariate time-series EHR data, often fall short of…

Computation and Language · Computer Science 2025-02-27 Yinghao Zhu , Changyu Ren , Zixiang Wang , Xiaochen Zheng , Shiyun Xie , Junlan Feng , Xi Zhu , Zhoujun Li , Liantao Ma , Chengwei Pan

After natural disasters, accurate evaluations of damage to housing are important for insurance claims response and planning of resources. In this work, we introduce a novel multimodal retrieval-augmented generation (MM-RAG) framework. On…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Jiayi Miao , Dingxin Lu , Zhuqi Wang

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

Gait analysis is essential in post-stroke rehabilitation but remains time-intensive and cognitively demanding, especially when clinicians must integrate gait videos and motion-capture data into structured reports. We present OGA-AID, a…

Human-Computer Interaction · Computer Science 2026-04-08 Khoi T. N. Nguyen , Nghia D. Nguyen , Hui Yu Koh , Patrick W. H. Kwong , Karen Sui Geok Chua , Ananda Sidarta , Baosheng Yu

Recent advancements in table-based reasoning have expanded beyond factoid-level QA to address insight-level tasks, where systems should synthesize implicit knowledge in the table to provide explainable analyses. Although effective, existing…

Computation and Language · Computer Science 2025-06-03 Kwangwook Seo , Donguk Kwon , Dongha Lee

Retrieval-augmented generation (RAG) techniques have emerged as a promising solution to enhance the reliability of large language models (LLMs) by addressing issues like hallucinations, outdated knowledge, and domain adaptation. In…

Computation and Language · Computer Science 2025-01-28 Weihang Su , Yichen Tang , Qingyao Ai , Junxi Yan , Changyue Wang , Hongning Wang , Ziyi Ye , Yujia Zhou , Yiqun Liu

Existing deep learning methods for radiology report generation enhance diagnostic efficiency but often overlook physician-informed medical priors. This leads to a suboptimal alignment between the structured explanations and disease…

Tissues and Organs · Quantitative Biology 2026-04-13 Aishik Konwer , Moinak Bhattacharya , Prateek Prasanna

The increasing prevalence of retinal diseases poses a significant challenge to the healthcare system, as the demand for ophthalmologists surpasses the available workforce. This imbalance creates a bottleneck in diagnosis and treatment,…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Jia-Hong Huang

Recent advancements in generative AI have fostered the development of highly adept Large Language Models (LLMs) that integrate diverse data types to empower decision-making. Among these, multimodal retrieval-augmented generation (RAG)…

Information Retrieval · Computer Science 2025-09-03 Aritra Kumar Lahiri , Qinmin Vivian Hu

Medical retrieval-augmented generation (RAG) systems typically operate on text chunks extracted from biomedical literature, discarding the rich visual content (tables, figures, structured layouts) of original document pages. We propose…

Artificial Intelligence · Computer Science 2026-05-01 Xupeng Chen , Binbin Shi , Chenqian Le , Jiaqi Zhang , Kewen Wang , Ran Gong , Jinhan Zhang , Chihang Wang

Current medical language models, adapted from large language models (LLMs), typically predict ICD code-based diagnosis from electronic health records (EHRs) because these labels are readily available. However, ICD codes do not capture the…

Computation and Language · Computer Science 2025-12-09 Wenhao Li , Hongkuan Zhang , Hongwei Zhang , Zhengxu Li , Zengjie Dong , Yafan Chen , Niranjan Bidargaddi , Hong Liu

While large language models (LLMs) have achieved state-of-the-art performance on a wide range of medical question answering (QA) tasks, they still face challenges with hallucinations and outdated knowledge. Retrieval-augmented generation…

Computation and Language · Computer Science 2024-02-26 Guangzhi Xiong , Qiao Jin , Zhiyong Lu , Aidong Zhang