English
Related papers

Related papers: MMedAgent: Learning to Use Medical Tools with Mult…

200 papers

Despite advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), their integration into language-grounded, human-like embodied agents remains incomplete, hindering complex real-life task performance in physical…

Computation and Language · Computer Science 2024-08-20 Zhili Cheng , Zhitong Wang , Jinyi Hu , Shengding Hu , An Liu , Yuge Tu , Pengkai Li , Lei Shi , Zhiyuan Liu , Maosong Sun

Decades' advances in digital health technologies, such as electronic health records, have largely streamlined routine clinical processes. Yet, most these systems are still hard to learn and use: Clinicians often face the burden of managing…

Artificial Intelligence · Computer Science 2025-09-16 Jared Zhu , Junde Wu

The recent advance in Large Language Models (LLMs) has shaped a new paradigm of AI agents, i.e., LLM-based agents. Compared to standalone LLMs, LLM-based agents substantially extend the versatility and expertise of LLMs by enhancing LLMs…

Software Engineering · Computer Science 2025-12-04 Junwei Liu , Kaixin Wang , Yixuan Chen , Xin Peng , Zhenpeng Chen , Lingming Zhang , Yiling Lou

Agents utilizing tools powered by large language models (LLMs) or vision-language models (VLMs) have demonstrated remarkable progress in diverse tasks across text and visual modalities. Unlike traditional tools such as calculators, which…

Computation and Language · Computer Science 2025-10-09 Yunzhong Xiao , Yangmin Li , Hewei Wang , Yunlong Tang , Zora Zhiruo Wang

Large Language Models (LLMs) based agents are transforming the programming language landscape by facilitating learning for beginners, enabling code generation, and optimizing documentation workflows. Hardware Description Languages (HDLs),…

Hardware Architecture · Computer Science 2025-01-03 Mark Zakharov , Farzaneh Rabiei Kashanaki , Jose Renau

The proliferation of Large Language Models (LLMs) in recent years has realized many applications in various domains. Being trained with a huge of amount of data coming from various sources, LLMs can be deployed to solve different tasks,…

Software Engineering · Computer Science 2025-03-17 Duc S. H. Nguyen , Bach G. Truong , Phuong T. Nguyen , Juri Di Rocco , Davide Di Ruscio

Large Language Models (LLMs) achieve competitive results compared to human experts in medical examinations. However, it remains a challenge to apply LLMs to complex clinical decision-making, which requires a deep understanding of medical…

To accelerate mechanical design and enhance design quality and innovation, we present a Multidisciplinary Design and Optimization (MDO) Agent driven by Large Language Models (LLMs). The agent semi-automates the end-to-end workflow by…

Human-Computer Interaction · Computer Science 2025-11-25 Bingkun Guo , Wentian Li , Xiaojian Liu , Jiaqi Luo , Zibin Yu , Dalong Dong , Shuyou Zhang , Yiming Zhang

Recent large language models (LLMs) have demonstrated significant advancements, particularly in their ability to serve as agents thereby surpassing their traditional role as chatbots. These agents can leverage their planning and tool…

Machine Learning · Computer Science 2025-02-13 Yixing Jiang , Kameron C. Black , Gloria Geng , Danny Park , James Zou , Andrew Y. Ng , Jonathan H. Chen

Large Language Models (LLMs) are transforming healthcare through the development of LLM-based agents that can understand, reason about, and assist with medical tasks. This survey provides a comprehensive review of LLM-based agents in…

Computation and Language · Computer Science 2025-05-27 Wenxuan Wang , Zizhan Ma , Zheng Wang , Chenghan Wu , Jiaming Ji , Wenting Chen , Xiang Li , Yixuan Yuan

Large Language Models (LLMs) have enabled multi-agent systems to perform autonomous code generation for complex tasks. Despite the recent growth in research and industrial applications in this area, there is little work on synthesizing…

Software Engineering · Computer Science 2026-04-21 Zeeshan Rasheeda , Muhammad Waseema , Kai-Kristian Kemella , Mika Saari , Pekka Abrahamsson

The development of autonomous machine learning (ML) agents capable of end-to-end data science workflows represents a significant frontier in artificial intelligence. These agents must orchestrate complex sequences of data analysis, feature…

Machine Learning · Computer Science 2026-02-24 Yaswanth Chittepu , Raghavendra Addanki , Tung Mai , Anup Rao , Branislav Kveton

Evaluating large language models (LLM) in clinical scenarios is crucial to assessing their potential clinical utility. Existing benchmarks rely heavily on static question-answering, which does not accurately depict the complex, sequential…

Human-Computer Interaction · Computer Science 2025-05-27 Samuel Schmidgall , Rojin Ziaei , Carl Harris , Eduardo Reis , Jeffrey Jopling , Michael Moor

This study presents the LLM-Agent-Controller, a multi-agent large language model (LLM) system developed to address a wide range of problems in control engineering (Control Theory). The system integrates a central controller agent with…

Artificial Intelligence · Computer Science 2025-05-27 Rasoul Zahedifar , Sayyed Ali Mirghasemi , Mahdieh Soleymani Baghshah , Alireza Taheri

Advancements in large language models (LLMs) allow them to address diverse questions using human-like interfaces. Still, limitations in their training prevent them from answering accurately in scenarios that could benefit from multiple…

Artificial Intelligence · Computer Science 2025-04-09 Yoshitaka Inoue , Tianci Song , Xinling Wang , Augustin Luna , Tianfan Fu

A central aspect of machine learning research is experimentation, the process of designing and running experiments, analyzing the results, and iterating towards some positive outcome (e.g., improving accuracy). Could agents driven by…

Machine Learning · Computer Science 2024-04-16 Qian Huang , Jian Vora , Percy Liang , Jure Leskovec

Medical diagnosis using Large Multimodal Models (LMMs) has gained increasing attention due to capability of these models in providing precise diagnoses. These models generally combine medical questions with visual inputs to generate…

Image and Video Processing · Electrical Eng. & Systems 2026-04-09 Ashmal Vayani , Parth Parag Kulkarni , Joseph Fioresi , Song Wang , Mubarak Shah

Causal discovery is an imperative foundation for decision-making across domains, such as smart health, AI for drug discovery and AIOps. Traditional statistical causal discovery methods, while well-established, predominantly rely on…

Machine Learning · Computer Science 2025-06-03 ChengAo Shen , Zhengzhang Chen , Dongsheng Luo , Dongkuan Xu , Haifeng Chen , Jingchao Ni

Multi-modal Large Language Model (MLLM) refers to a model expanded from a Large Language Model (LLM) that possesses the capability to handle and infer multi-modal data. Current MLLMs typically begin by using LLMs to decompose tasks into…

Computation and Language · Computer Science 2023-09-01 Yongqiang Zhao , Zhenyu Li , Feng Zhang , Xinhai Xu , Donghong Liu

Mobile agents are essential for automating tasks in complex and dynamic mobile environments. As foundation models evolve, the demands for agents that can adapt in real-time and process multimodal data have grown. This survey provides a…

Artificial Intelligence · Computer Science 2025-09-16 Biao Wu , Yanda Li , Zhiwei Zhang , Yunchao Wei , Meng Fang , Ling Chen