English
Related papers

Related papers: MAM: Modular Multi-Agent Framework for Multi-Modal…

200 papers

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Empowered by vast internal knowledge reservoir, the new generation of large language models (LLMs) demonstrate untapped potential to tackle medical tasks. However, there is insufficient effort made towards summoning up a synergic effect…

Computation and Language · Computer Science 2025-05-23 Kexin Shang , Chia-Hsuan Chang , Christopher C. Yang

Recent advancements in artificial intelligence (AI), especially large language models (LLMs), have significantly advanced healthcare applications and demonstrated potentials in intelligent medical treatment. However, there are conspicuous…

Computation and Language · Computer Science 2025-05-26 Qinkai Yu , Mingyu Jin , Dong Shu , Chong Zhang , Lizhou Fan , Wenyue Hua , Suiyuan Zhu , Yanda Meng , Zhenting Wang , Mengnan Du , Yongfeng Zhang

Artificial intelligence has significantly advanced healthcare, particularly through large language models (LLMs) that excel in medical question answering benchmarks. However, their real-world clinical application remains limited due to the…

Computation and Language · Computer Science 2024-07-01 Zhihao Fan , Jialong Tang , Wei Chen , Siyuan Wang , Zhongyu Wei , Jun Xi , Fei Huang , Jingren Zhou

Medical large vision-language models (LVLMs) have demonstrated promising performance across various single-image question answering (QA) benchmarks, yet their capability in processing multi-image clinical scenarios remains underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Xikai Yang , Juzheng Miao , Yuchen Yuan , Jiaze Wang , Qi Dou , Jinpeng Li , Pheng-Ann Heng

Multimodal (MM) learning is emerging as a promising paradigm in biomedical artificial intelligence (AI) applications, integrating complementary modality, which highlight different aspects of patient health. The scarcity of large…

Artificial Intelligence · Computer Science 2025-12-01 Niccolo Marini , Zhaohui Liang , Sivaramakrishnan Rajaraman , Zhiyun Xue , Sameer Antani

Multimodal clinical reasoning in the field of gastrointestinal (GI) oncology necessitates the integrated interpretation of endoscopic imagery, radiological data, and biochemical markers. Despite the evident potential exhibited by Multimodal…

Accurate and interpretable multi-disease diagnosis remains a critical challenge in medical research, particularly when leveraging heterogeneous multimodal medical data. Current approaches often rely on single-modal data, limiting their…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Yuting Zhang , Kaishen Yuan , Hao Lu , Yutao Yue , Jintai Chen , Kaishun Wu

The rapid advancement of Large Language Models (LLMs) has stimulated interest in multi-agent collaboration for addressing complex medical tasks. However, the practical advantages of multi-agent collaboration approaches remain insufficiently…

Artificial Intelligence · Computer Science 2025-10-31 Yinghao Zhu , Ziyi He , Haoran Hu , Xiaochen Zheng , Xichen Zhang , Zixiang Wang , Junyi Gao , Liantao Ma , Lequan Yu

Multi-modal learning has emerged as a key technique for improving performance across domains such as autonomous driving, robotics, and reasoning. However, in certain scenarios, particularly in resource-constrained environments, some…

Robotics · Computer Science 2026-01-01 Rui Liu , Yu Shen , Peng Gao , Pratap Tokekar , Ming Lin

Multi-agent large language models (MA-LLMs) are a rapidly growing research area that leverages multiple interacting language agents to tackle complex tasks, outperforming single-agent large language models. This literature review…

Multiagent Systems · Computer Science 2025-06-03 Arne Tillmann

Recent developments in large language models (LLMs) have unlocked new opportunities for healthcare, from information synthesis to clinical decision support. These new LLMs are not just capable of modeling language, but can also act as…

Human-Computer Interaction · Computer Science 2023-09-21 Nikita Mehandru , Brenda Y. Miao , Eduardo Rodriguez Almaraz , Madhumita Sushil , Atul J. Butte , Ahmed Alaa

The development of large language models (LLMs) has brought unprecedented possibilities for artificial intelligence (AI) based medical diagnosis. However, the application perspective of LLMs in real diagnostic scenarios is still unclear…

Computation and Language · Computer Science 2024-05-21 Zhoujian Sun , Cheng Luo , Ziyi Liu , Zhengxing Huang

In the face of rapidly expanding online medical literature, automated systems for aggregating and summarizing information are becoming increasingly crucial for healthcare professionals and patients. Large Language Models (LLMs), with their…

Computation and Language · Computer Science 2024-03-07 Niraj Yagnik , Jay Jhaveri , Vivek Sharma , Gabriel Pila

Medical diagnosis using Large Multimodal Models (LMMs) has gained increasing attention due to capability of these models in providing precise diagnoses. These models generally combine medical questions with visual inputs to generate…

Image and Video Processing · Electrical Eng. & Systems 2026-04-09 Ashmal Vayani , Parth Parag Kulkarni , Joseph Fioresi , Song Wang , Mubarak Shah

Recent advancements in large language models (LLMs) have given rise to the LLM-as-a-judge paradigm, showcasing their potential to deliver human-like judgments. However, in the field of machine translation (MT) evaluation, current…

Computation and Language · Computer Science 2025-02-21 Zhaopeng Feng , Jiayuan Su , Jiamei Zheng , Jiahan Ren , Yan Zhang , Jian Wu , Hongwei Wang , Zuozhu Liu

The adoption of large language models (LLMs) in healthcare has attracted significant research interest. However, their performance in healthcare remains under-investigated and potentially limited, due to i) they lack rich domain-specific…

Artificial Intelligence · Computer Science 2024-05-21 Zishan Gu , Fenglin Liu , Changchang Yin , Ping Zhang

Multi-agent collaboration among models has shown promise in reasoning tasks but is underexplored in long-form generation tasks like summarization and question-answering. We extend multi-agent multi-model reasoning to generation,…

Computation and Language · Computer Science 2025-03-20 David Wan , Justin Chih-Yao Chen , Elias Stengel-Eskin , Mohit Bansal

Evaluating large language models (LLM) in clinical scenarios is crucial to assessing their potential clinical utility. Existing benchmarks rely heavily on static question-answering, which does not accurately depict the complex, sequential…

Human-Computer Interaction · Computer Science 2025-05-27 Samuel Schmidgall , Rojin Ziaei , Carl Harris , Eduardo Reis , Jeffrey Jopling , Michael Moor

Large Language Models (LLMs) have made significant progress in various fields. However, challenges remain in Multi-Disciplinary Team (MDT) medical consultations. Current research enhances reasoning through role assignment, task…

Artificial Intelligence · Computer Science 2025-03-19 Kai Chen , Xinfeng Li , Tianpei Yang , Hewei Wang , Wei Dong , Yang Gao