English
Related papers

Related papers: Proactive Reasoning-with-Retrieval Framework for M…

200 papers

Medical report generation is one of the most challenging tasks in medical image analysis. Although existing approaches have achieved promising results, they either require a predefined template database in order to retrieve sentences or…

Computation and Language · Computer Science 2021-06-14 Xingyi Yang , Muchao Ye , Quanzeng You , Fenglong Ma

Multimodal biomedical Vision-Language Models (VLMs) exhibit immense potential in the field of Continual Learning (CL). However, they confront a core dilemma: how to preserve fine-grained intra-modality features while bridging the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zizhi Chen , Yizhen Gao , Minghao Han , Yizhou Liu , Zhaoyu Chen , Dingkang Yang , Lihua Zhang

The differential diagnosis of neurodegenerative dementias is a challenging clinical task, mainly because of the overlap in symptom presentation and the similarity of patterns observed in structural neuroimaging. To improve diagnostic…

Machine Learning · Computer Science 2025-05-27 Andrew Zamai , Nathanael Fijalkow , Boris Mansencal , Laurent Simon , Eloi Navet , Pierrick Coupe

While reasoning-enhanced large language models perform strongly on English medical tasks, a persistent multilingual gap remains, with substantially weaker reasoning in local languages, limiting equitable global medical deployment. To bridge…

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant potential in recommendation systems. However, the effective application of MLLMs to multimodal sequential recommendation remains unexplored: A)…

Information Retrieval · Computer Science 2025-12-25 Haoyu Wang , Yitong Wang , Jining Wang

Large Language Models (LLMs), although powerful in general domains, often perform poorly on domain-specific tasks such as medical question answering (QA). In addition, LLMs tend to function as "black-boxes", making it challenging to modify…

Computation and Language · Computer Science 2024-08-19 Yucheng Shi , Shaochen Xu , Tianze Yang , Zhengliang Liu , Tianming Liu , Quanzheng Li , Xiang Li , Ninghao Liu

Biomedical question answering (QA) requires accurate interpretation of complex medical knowledge. Large language models (LLMs) have shown promising capabilities in this domain, with retrieval-augmented generation (RAG) systems enhancing…

Computation and Language · Computer Science 2025-10-21 Yingpeng Ning , Yuanyuan Sun , Ling Luo , Yanhua Wang , Yuchen Pan , Hongfei Lin

Vision-Language Models (VLMs) frequently suffer from visual perception errors and hallucinations that compromise answer accuracy in complex reasoning tasks. Reinforcement Learning with Verifiable Rewards (RLVR) offers a promising solution…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yin Zhang , Jiaxuan Zhao , Zonghan Wu , Zengxiang Li , Junfeng Fang , Kun Wang , Qingsong Wen , Yilei Shao

The rapid growth of medical knowledge and increasing complexity of clinical practice pose challenges. In this context, large language models (LLMs) have demonstrated value; however, inherent limitations remain. Retrieval-augmented…

Multimodal retrieval over text corpora remains a fundamental challenge: the best vision-language encoder achieves only 27.6 nDCG@10 on MM-BRIGHT, a reasoning-intensive multimodal retrieval benchmark, underperforming strong text-only…

Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes. Retrieval-Augmented Generation (RAG) has emerged as a…

Computation and Language · Computer Science 2024-03-28 Yunfan Gao , Yun Xiong , Xinyu Gao , Kangxiang Jia , Jinliu Pan , Yuxi Bi , Yi Dai , Jiawei Sun , Meng Wang , Haofen Wang

Misdiagnosis causes significant harm to healthcare systems worldwide, leading to increased costs and patient risks. MedRAG is a smart multimodal healthcare copilot equipped with powerful large language model (LLM) reasoning, designed to…

Artificial Intelligence · Computer Science 2025-06-04 Xuejiao Zhao , Siyan Liu , Su-Yin Yang , Chunyan Miao

Large Language Models (LLMs) and their multimodal variants (LVLMs) hold immense promise for scientific and engineering applications, particularly in processing visual information like scientific diagrams. However, their practical deployment…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Minghao Zhou , Rafael Souza , Yaqian Hu , Luming Che

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in processing and generating content across multiple data modalities. However, a significant drawback of MLLMs is their reliance on static training data,…

Artificial Intelligence · Computer Science 2024-09-26 Zhanpeng Chen , Chengjin Xu , Yiyan Qi , Jian Guo

Large language models (LLM) have demonstrated remarkable capabilities in various biomedical natural language processing (NLP) tasks, leveraging the demonstration within the input context to adapt to new tasks. However, LLM is sensitive to…

Computation and Language · Computer Science 2025-11-17 Mingchen Li , Zaifu Zhan , Han Yang , Yongkang Xiao , Jiatan Huang , Rui Zhang

Clinical diagnosis is a highly specialized discipline requiring both domain expertise and strict adherence to rigorous guidelines. While current AI-driven medical research predominantly focuses on knowledge graphs or natural text…

Machine Learning · Computer Science 2025-12-12 Haolin Li , Tianjie Dai , Zhe Chen , Siyuan Du , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Recent developments in Large Language Model (LLM)-based agents have shown impressive capabilities spanning multiple domains, exemplified by deep research systems that demonstrate superior performance on complex information-seeking and…

Computation and Language · Computer Science 2025-09-03 Ailing Yu , Lan Yao , Jingnan Liu , Zhe Chen , Jiajun Yin , Yuan Wang , Xinhao Liao , Zhiling Ye , Ji Li , Yun Yue , Hansong Xiao , Hualei Zhou , Chunxiao Guo , Peng Wei , Junwei Liu , Jinjie Gu

Recent advances in vision-language models (VLMs) have achieved remarkable performance on standard medical benchmarks, yet their true clinical reasoning ability remains unclear. Existing datasets predominantly emphasize classification…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Miao Jing , Mengting Jia , Junling Lin , Zhongxia Shen , Huan Gao , Mingkun Xu , Shangyang Li

Recent advances in medical large language models have explored Test-Time Reinforcement Learning (TTRL) to enhance reasoning. However, standard TTRL often relies on majority voting (MV) as a heuristic supervision signal, which can be…

Machine Learning · Computer Science 2026-03-11 Kailong Fan , Anqi Pu , Yichen Wu , Wanhua Li , Yicong Li , Hanspeter Pfister , Huafeng Liu , Xiang Li , Quanzheng Li , Ning Guo

Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data. Retrieval-Augmented Generation (RAG) mitigates these issues by integrating external dynamic information for…