中文
相关论文

相关论文: MAM: Modular Multi-Agent Framework for Multi-Modal…

200 篇论文

Modern signal processing (SP) pipelines, whether model-based or data-driven, often constrained by complex and fragmented workflow, rely heavily on expert knowledge and manual engineering, and struggle with adaptability and generalization…

机器学习 · 计算机科学 2025-10-31 Junlong Ke , Qiying Hu , Shenghai Yuan , Yuecong Xu , Jianfei Yang

Large Language Models (LLMs) have shown promising potential in the medical domain, assisting with tasks like clinical note generation and patient communication. However, current LLMs are limited to text-based communication, hindering their…

计算与语言 · 计算机科学 2025-06-17 Yusheng Liao , Shuyang Jiang , Yanfeng Wang , Yu Wang

Large language models (LLMs) have shown promise in medical domains, but their ability to handle specialized neurological reasoning requires systematic evaluation. We developed a comprehensive benchmark using 305 questions from Israeli Board…

信息检索 · 计算机科学 2025-08-21 Moran Sorka , Alon Gorenshtein , Dvir Aran , Shahar Shelly

Complex medical decision-making involves cooperative workflows operated by different clinicians. Designing AI multi-agent systems can expedite and augment human-level clinical decision-making. Existing multi-agent researches primarily focus…

人工智能 · 计算机科学 2025-10-14 Kaitao Chen , Mianxin Liu , Daoming Zong , Chaoyue Ding , Shaohao Rui , Yankai Jiang , Mu Zhou , Xiaosong Wang

LLM-based agents have emerged as transformative tools capable of executing complex tasks through iterative planning and action, achieving significant advancements in understanding and addressing user needs. Yet, their effectiveness remains…

人机交互 · 计算机科学 2025-08-26 Mithat Can Ozgun , Jiahuan Pei , Koen Hindriks , Lucia Donatelli , Qingzhi Liu , Junxiao Wang

The recent success of Large Language Models (LLMs) has had a significant impact on the healthcare field, providing patients with medical advice, diagnostic information, and more. However, due to a lack of professional medical knowledge,…

计算与语言 · 计算机科学 2024-06-27 Wenya Xie , Qingying Xiao , Yu Zheng , Xidong Wang , Junying Chen , Ke Ji , Anningzhe Gao , Xiang Wan , Feng Jiang , Benyou Wang

In recent years, accurately and quickly deploying medical large language models (LLMs) has become a trend. Among these, retrieval-augmented generation (RAG) has garnered attention due to rapid deployment and privacy protection. However, the…

计算与语言 · 计算机科学 2025-08-06 Penglei Sun , Yixiang Chen , Xiang Li , Xiaowen Chu

Large Language Models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence (AI) technology which is rapidly evolving and promises to aid in medical diagnosis either by assisting doctors or by simulating a doctor's…

Large language models (LLMs) have emerged as powerful tools with transformative potential across numerous domains, including healthcare and medicine. In the medical domain, LLMs hold promise for tasks ranging from clinical decision support…

计算与语言 · 计算机科学 2024-05-14 Xiaolan Chen , Jiayang Xiang , Shanfu Lu , Yexin Liu , Mingguang He , Danli Shi

We present a framework for training large language models (LLMs) as diagnostic agents with reinforcement learning, enabling them to manage multi-turn interactive diagnostic processes, adaptively select examinations, and commit to final…

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

信息检索 · 计算机科学 2025-05-16 Alejo Lopez-Avila , Jinhua Du

We introduce DriveAgent, a novel multi-agent autonomous driving framework that leverages large language model (LLM) reasoning combined with multimodal sensor fusion to enhance situational understanding and decision-making. DriveAgent…

机器人学 · 计算机科学 2025-05-06 Xinmeng Hou , Wuqi Wang , Long Yang , Hao Lin , Jinglun Feng , Haigen Min , Xiangmo Zhao

Medical Multimodal Large Language Models (Med-MLLMs) have shown great promise in medical visual question answering (Med-VQA). However, when deployed in low-resource settings where abundant labeled data are unavailable, existing Med-MLLMs…

计算与语言 · 计算机科学 2025-10-06 Ziqing Wang , Chengsheng Mao , Xiaole Wen , Yuan Luo , Kaize Ding

Real-world multimodal applications often require any-to-any capabilities, enabling both understanding and generation across modalities including text, image, audio, and video. However, integrating the strengths of autoregressive language…

机器学习 · 计算机科学 2025-08-15 Jiulin Li , Ping Huang , Yexin Li , Shuo Chen , Juewen Hu , Ye Tian

Autonomous agents driven by Large Language Models (LLMs) offer enormous potential for automation. Early proof of this technology can be found in various demonstrations of agents solving complex tasks, interacting with external systems to…

Medical vision-language models (VLMs) show strong performance on radiology tasks but often produce fluent yet weakly grounded conclusions due to over-reliance on a dominant modality. We introduce a context-aligned reasoning framework that…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Sumra Khan , Sagar Chhabriya , Aizan Zafar , Sheeraz Arif , Amgad Muneer , Anas Zafar , Shaina Raza , Rizwan Qureshi

Answering complex medical questions requires not only domain expertise and patient-specific information, but also structured and multi-perspective reasoning. Existing multi-agent approaches often rely on fixed roles or shallow interaction…

人工智能 · 计算机科学 2026-03-04 Siqi Ma , Jiajie Huang , Fan Zhang , Yue Shen , Jinlin Wu , Guohui Fan , Zhu Zhang , Zelin Zang

Multi-table entity matching (MEM) addresses the limitations of dual-table approaches by enabling simultaneous identification of equivalent entities across multiple data sources without unique identifiers. However, existing methods relying…

计算与语言 · 计算机科学 2026-04-24 Yingkai Tang , Taoyu Su , Wenyuan Zhang , Xiaoyang Guo , Tingwen Liu

Large language models (LLMs) struggle in real-world clinical consultations. Single-turn consultation systems require patients to describe all symptoms at once, which often leads to unclear complaints and vague diagnoses. Traditional…

计算与语言 · 计算机科学 2026-05-01 Yichun Feng , Jiawei Wang , Lu Zhou , Yikai Zheng , Zhen Lei , Yixue Li

In the past year, MultiModal Large Language Models (MM-LLMs) have undergone substantial advancements, augmenting off-the-shelf LLMs to support MM inputs or outputs via cost-effective training strategies. The resulting models not only…

计算与语言 · 计算机科学 2024-05-29 Duzhen Zhang , Yahan Yu , Jiahua Dong , Chenxing Li , Dan Su , Chenhui Chu , Dong Yu