English
Related papers

Related papers: ProtoMedAgent: Multimodal Clinical Interpretabilit…

200 papers

Ransomware has become one of the most serious cybersecurity threats causing major financial losses and operational disruptions worldwide.Traditional detection methods such as static analysis, heuristic scanning and behavioral analysis often…

Cryptography and Security · Computer Science 2026-03-04 Asifullah Khan , Aimen Wadood , Mubashar Iqbal , Umme Zahoora

Clinical diagnosis is a highly specialized discipline requiring both domain expertise and strict adherence to rigorous guidelines. While current AI-driven medical research predominantly focuses on knowledge graphs or natural text…

Machine Learning · Computer Science 2025-12-12 Haolin Li , Tianjie Dai , Zhe Chen , Siyuan Du , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

Large Language Models (LLMs) have become increasingly integral to enhancing developer productivity, particularly in code generation, comprehension, and repair tasks. However, fine-tuning these models with high-quality, real-world data is…

Software Engineering · Computer Science 2024-12-12 Xiaoyun Liang , Jingyi Ren , Jiayi Qi , Chao Peng , Bo Jiang

Large Language Models (LLMs) have advanced artificial intelligence by enabling human-like text generation and natural language understanding. However, their reliance on static training data limits their ability to respond to dynamic,…

Artificial Intelligence · Computer Science 2026-04-02 Aditi Singh , Abul Ehtesham , Saket Kumar , Tala Talaei Khoei , Athanasios V. Vasilakos

Can generative agents be trusted in multimodal environments? Despite advances in large language and vision-language models that enable agents to act autonomously and pursue goals in rich settings, their ability to reason about safety,…

Artificial Intelligence · Computer Science 2025-10-10 Alhim Vera , Karen Sanchez , Carlos Hinojosa , Haidar Bin Hamid , Donghoon Kim , Bernard Ghanem

Multimodal deep learning has shown promise in depression detection by integrating text, audio, and video signals. Recent work leverages sentiment analysis to enhance emotional understanding, yet suffers from high computational cost, domain…

Machine Learning · Computer Science 2025-11-05 Ruibo Hou , Shiyu Teng , Jiaqing Liu , Shurong Chai , Yinhao Li , Lanfen Lin , Yen-Wei Chen

Analyzing whole-slide images (WSIs) requires an iterative, evidence-driven reasoning process that parallels how pathologists dynamically zoom, refocus, and self-correct while collecting the evidence. However, existing computational…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jingyun Chen , Linghan Cai , Zhikang Wang , Yi Huang , Songhan Jiang , Shenjin Huang , Hongpeng Wang , Yongbing Zhang

Healthcare and medicine are multimodal disciplines that deal with multimodal data for reasoning and diagnosing multiple diseases. Although some multimodal reasoning models have emerged for reasoning complex tasks in scientific domains,…

Artificial Intelligence · Computer Science 2025-09-16 Susanta Mitra

Large Language Models (LLMs) and Multimodal LLMs (MLLMs) have demonstrated immense potential in autonomous driving (AD) by offering human-like reasoning and open-world generalization. However, the excessive computational overhead and high…

Robotics · Computer Science 2026-05-26 Ruoyu Yao , Ruiguo Zhong , Pei Liu , Mingxing Peng , Rui Yang , Jun Ma

Multimodal Large Language Models have shown promising capabilities in bridging visual and textual reasoning, yet their reasoning capabilities in Open-Vocabulary Human-Object Interaction (OV-HOI) are limited by cross-modal hallucinations and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zhenlong Yuan , Yue Wang , Dapeng Zhang , Kejin Cui , Rui Chen , Jing Tang , Lei Sun , Hongwei Yu , Chengxuan Qian , Xiangxiang Chu , Shuo Li , Yuyin Zhou

We present a framework for training large language models (LLMs) as diagnostic agents with reinforcement learning, enabling them to manage multi-turn interactive diagnostic processes, adaptively select examinations, and commit to final…

Computation and Language · Computer Science 2026-02-11 Pengcheng Qiu , Chaoyi Wu , Junwei Liu , Qiaoyu Zheng , Yusheng Liao , Haowen Wang , Yun Yue , Qianrui Fan , Shuai Zhen , Jian Wang , Jinjie Gu , Yanfeng Wang , Ya Zhang , Weidi Xie

Accurate and interpretable multi-disease diagnosis remains a critical challenge in medical research, particularly when leveraging heterogeneous multimodal medical data. Current approaches often rely on single-modal data, limiting their…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Yuting Zhang , Kaishen Yuan , Hao Lu , Yutao Yue , Jintai Chen , Kaishun Wu

Tabular biomedical data poses challenges in machine learning because it is often high-dimensional and typically low-sample-size (HDLSS). Previous research has attempted to address these challenges via local feature selection, but existing…

Machine Learning · Computer Science 2024-06-04 Xiangjian Jiang , Andrei Margeloiu , Nikola Simidjievski , Mateja Jamnik

Interpretability is often an essential requirement in medical imaging. Advanced deep learning methods are required to address this need for explainability and high performance. In this work, we investigate whether additional information…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Luisa Gallee , Meinrad Beer , Michael Goetz

Clinical diagnosis is a complex reasoning process in which clinicians gather evidence, form hypotheses, and test them against alternative explanations. In medical training, this reasoning is explicitly developed through counterfactual…

Computation and Language · Computer Science 2026-04-24 Zhiwen You , Xi Chen , Aniket Vashishtha , Simo Du , Gabriel Erion-Barner , Hongyuan Mei , Hao Peng , Yue Guo

Retrieval-Augmented Generation (RAG) aims to reduce hallucination by grounding answers in retrieved evidence, yet hallucinated answers remain common even when relevant documents are available. Existing evaluations focus on answer-level or…

Computation and Language · Computer Science 2026-05-21 Passant Elchafei , Monorama Swain , Shahed Masoudian , Markus Schedl

Large-scale language models (LLMs) have achieved remarkable success across various language tasks but suffer from hallucinations and temporal misalignment. To mitigate these shortcomings, Retrieval-augmented generation (RAG) has been…

Computation and Language · Computer Science 2024-04-30 Zhongzhen Huang , Kui Xue , Yongqi Fan , Linjie Mu , Ruoyu Liu , Tong Ruan , Shaoting Zhang , Xiaofan Zhang

Vision-Language Models (VLMs) show promise in medical diagnosis, yet suffer from reasoning detachment, where linguistically fluent explanations drift from verifiable image evidence, undermining clinical trust. Recent multi-agent frameworks…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Qianhan Feng , Zhongzhen Huang , Yakun Zhu , Xiaofan Zhang , Qi Dou

The rapid growth of user-generated text across digital platforms has intensified the need for interpretable models capable of fine-grained text classification and explanation. Existing prototype-based models offer intuitive explanations but…

Artificial Intelligence · Computer Science 2026-05-19 Utsav Kumar Nareti , Suraj Kumar , Soumya Pandey , Soumi Chattopadhyay , Chandranath Adak , Sankha Subhra Mullick