中文
相关论文

相关论文: MAM: Modular Multi-Agent Framework for Multi-Modal…

200 篇论文

The integration of Large Language Models (LLMs) into medical applications has sparked widespread interest across the healthcare industry, from drug discovery and development to clinical decision support, assisting telemedicine, medical…

计算与语言 · 计算机科学 2024-12-03 Zifeng Wang , Hanyin Wang , Benjamin Danek , Ying Li , Christina Mack , Hoifung Poon , Yajuan Wang , Pranav Rajpurkar , Jimeng Sun

Large Language Models (LLMs) have significantly advanced medical question-answering by leveraging extensive clinical data and medical literature. However, the rapid evolution of medical knowledge and the labor-intensive process of manually…

计算与语言 · 计算机科学 2025-07-01 Mohammad Reza Rezaei , Reza Saadati Fard , Jayson L. Parker , Rahul G. Krishnan , Milad Lankarany

We propose TG-LMM (Text-Guided Large Multi-Modal Model), a novel approach that leverages textual descriptions of organs to enhance segmentation accuracy in medical images. Existing medical image segmentation methods face several challenges:…

计算机视觉与模式识别 · 计算机科学 2024-09-06 Yihao Zhao , Enhao Zhong , Cuiyun Yuan , Yang Li , Man Zhao , Chunxia Li , Jun Hu , Chenbin Liu

Large language models (LLMs) have substantially advanced machine learning research, including natural language processing, computer vision, data mining, etc., yet they still exhibit critical limitations in explainability, reliability,…

机器学习 · 计算机科学 2025-09-19 Xin Wang , Haoyang Li , Haibo Chen , Zeyang Zhang , Wenwu Zhu

Autonomous agents utilizing Large Language Models (LLMs) have demonstrated remarkable capabilities in isolated medical tasks like diagnosis and image analysis, but struggle with integrated clinical workflows that connect diagnostic…

人工智能 · 计算机科学 2025-10-14 Hongjie Zheng , Zesheng Shi , Ping Yi

We aim to present a comprehensive overview of the latest advancements in utilizing Large Language Models (LLMs) within the healthcare sector, emphasizing their transformative impact across various medical domains. LLMs have become pivotal…

计算与语言 · 计算机科学 2026-04-07 Ummara Mumtaz , Awais Ahmed , Summaya Mumtaz

Large language models (LLMs) as autonomous agents offer a novel avenue for tackling real-world challenges through a knowledge-driven manner. These LLM-enhanced methodologies excel in generalization and interpretability. However, the…

人工智能 · 计算机科学 2024-07-22 Kemou Jiang , Xuan Cai , Zhiyong Cui , Aoyong Li , Yilong Ren , Haiyang Yu , Hao Yang , Daocheng Fu , Licheng Wen , Pinlong Cai

Clinical diagnosis is a complex reasoning process in which clinicians gather evidence, form hypotheses, and test them against alternative explanations. In medical training, this reasoning is explicitly developed through counterfactual…

计算与语言 · 计算机科学 2026-04-24 Zhiwen You , Xi Chen , Aniket Vashishtha , Simo Du , Gabriel Erion-Barner , Hongyuan Mei , Hao Peng , Yue Guo

Multimodal large language models (MLLMs) achieve strong performance by jointly processing inputs from multiple modalities, such as vision, audio, and language. However, building such models or extending them to new modalities often requires…

机器学习 · 计算机科学 2026-03-24 Md Kaykobad Reza , Ameya Patil , Edward Ayrapetian , M. Salman Asif

Artificial Intelligence (AI) has become essential in modern healthcare, with large language models (LLMs) offering promising advances in clinical decision-making. Traditional model-based approaches, including those leveraging in-context…

Large language models (LLMs) have demonstrated remarkable performance on various medical benchmarks, but their capabilities across different cognitive levels remain underexplored. Inspired by Bloom's Taxonomy, we propose a…

计算与语言 · 计算机科学 2025-06-11 Yuxuan Zhou , Xien Liu , Chenwei Yan , Chen Ning , Xiao Zhang , Boxun Li , Xiangling Fu , Shijin Wang , Guoping Hu , Yu Wang , Ji Wu

Although instruction-tuned large language models (LLMs) have exhibited remarkable capabilities across various NLP tasks, their effectiveness on other data modalities beyond text has not been fully studied. In this work, we propose…

计算与语言 · 计算机科学 2023-06-16 Chenyang Lyu , Minghao Wu , Longyue Wang , Xinting Huang , Bingshuai Liu , Zefeng Du , Shuming Shi , Zhaopeng Tu

Large Language Models (LLMs) have demonstrated remarkable planning abilities across various domains, including robotics manipulation and navigation. While recent efforts in robotics have leveraged LLMs both for high-level and low-level…

机器人学 · 计算机科学 2025-08-26 Harsh Singh , Rocktim Jyoti Das , Mingfei Han , Preslav Nakov , Ivan Laptev

Large language models (LLMs) and vision-language models (VLMs) have the potential to transform biological research by enabling autonomous experimentation. Yet, their application remains constrained by rigid protocol design, limited…

机器人学 · 计算机科学 2025-07-03 Yibo Qiu , Zan Huang , Zhiyu Wang , Handi Liu , Yiling Qiao , Yifeng Hu , Shu'ang Sun , Hangke Peng , Ronald X Xu , Mingzhai Sun

MLLMs have recently become a focal point in the field of artificial intelligence research. Building on the strong capabilities of LLMs, MLLMs are adept at addressing complex multi-modal tasks. With the release of GPT-4, MLLMs have gained…

机器学习 · 计算机科学 2025-05-01 Jiarui Ye , Hao Tang

Large language models (LLMs) have achieved impressive results in natural language understanding, yet their reasoning capabilities remain limited when operating as single agents. Multi-Agent Debate (MAD) has been proposed to address this…

计算与语言 · 计算机科学 2026-03-25 Xiao Wang , Jia Wang , Yijie Wang , Pengtao Dang , Sha Cao , Chi Zhang

Multi-agent Large Language Model (LLM) systems have been leading the way in applied LLM research across a number of fields. One notable area is software development, where researchers have advanced the automation of code implementation,…

软件工程 · 计算机科学 2025-11-25 Vali Tawosi , Keshav Ramani , Salwa Alamir , Xiaomo Liu

The recommendation of medication is a vital aspect of intelligent healthcare systems, as it involves prescribing the most suitable drugs based on a patient's specific health needs. Unfortunately, many sophisticated models currently in use…

信息检索 · 计算机科学 2025-01-28 Qidong Liu , Xian Wu , Xiangyu Zhao , Yuanshao Zhu , Zijian Zhang , Feng Tian , Yefeng Zheng

Large Language Models (LLMs) are transforming artificial intelligence, enabling autonomous agents to perform diverse tasks across various domains. These agents, proficient in human-like text comprehension and generation, have the potential…

人工智能 · 计算机科学 2024-04-10 Saikat Barua

Therapy recommendation for chronic patients with multimorbidity is challenging due to risks of treatment conflicts. Existing decision support systems face scalability limitations. Inspired by the way in which general practitioners (GP)…

人工智能 · 计算机科学 2025-07-16 Yicong Wu , Ting Chen , Irit Hochberg , Zhoujian Sun , Ruth Edry , Zhengxing Huang , Mor Peleg