English
Related papers

Related papers: Coding Agents with Multimodal Browsing are General…

200 papers

We propose CAD-Assistant, a general-purpose CAD agent for AI-assisted design. Our approach is based on a powerful Vision and Large Language Model (VLLM) as a planner and a tool-augmentation paradigm using CAD-specific tools. CAD-Assistant…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Dimitrios Mallis , Ahmet Serdar Karadeniz , Sebastian Cavada , Danila Rukhovich , Niki Foteinopoulou , Kseniya Cherenkova , Anis Kacem , Djamila Aouada

With the rise of large language models (LLMs), researchers are increasingly exploring their applications in var ious vertical domains, such as software engineering. LLMs have achieved remarkable success in areas including code generation…

Software Engineering · Computer Science 2025-04-15 Haolin Jin , Linghan Huang , Haipeng Cai , Jun Yan , Bo Li , Huaming Chen

Information seeking is a fundamental requirement for humans. However, existing LLM agents rely heavily on open-web search, which exposes two fundamental weaknesses: online content is noisy and unreliable, and many real-world tasks require…

Computation and Language · Computer Science 2025-10-07 Yaxin Du , Yuanshuo Zhang , Xiyuan Yang , Yifan Zhou , Cheng Wang , Gongyi Zou , Xianghe Pang , Wenhao Wang , Menglan Chen , Shuo Tang , Zhiyu Li , Feiyu Xiong , Siheng Chen

Specialized clinical AI assistants are rapidly entering medical practice, often framed as safer or more reliable than general-purpose large language models (LLMs). Yet, unlike frontier models, these clinical tools are rarely subjected to…

Computation and Language · Computer Science 2025-12-02 Krithik Vishwanath , Mrigayu Ghosh , Anton Alyakin , Daniel Alexander Alber , Yindalon Aphinyanaphongs , Eric Karl Oermann

This paper investigates multimodal agents, in particular, OpenAI's Computer-User Agent (CUA), trained to control and complete tasks through a standard computer interface, similar to humans. We evaluated the agent's performance on the New…

Artificial Intelligence · Computer Science 2025-04-23 Sarath Shekkizhar , Romain Cosentino

The development of general-purpose agents requires a shift from executing simple instructions to completing complex, real-world productivity workflows. However, current tool-use benchmarks remain misaligned with real-world requirements,…

Computation and Language · Computer Science 2026-04-20 Jize Wang , Xuanxuan Liu , Yining Li , Songyang Zhang , Yijun Wang , Zifei Shan , Xinyi Le , Cailian Chen , Xinping Guan , Dacheng Tao

The development of AI agents based on large, open-domain language models (LLMs) has paved the way for the development of general-purpose AI assistants that can support human in tasks such as writing, coding, graphic design, and scientific…

Artificial Intelligence · Computer Science 2025-06-03 Mustafa Mert Çelikok , Saptarashmi Bandyopadhyay , Robert Loftin

Tool use has turned large language models (LLMs) into powerful agents that can perform complex multi-step tasks by dynamically utilising external software components. However, these tools must be implemented in advance by human developers,…

Computation and Language · Computer Science 2025-06-02 Georg Wölflein , Dyke Ferber , Daniel Truhn , Ognjen Arandjelović , Jakob Nikolas Kather

Recent advances in AI agents capable of solving complex, everyday tasks, from scheduling to customer service, have enabled deployment in real-world settings, but their possibilities for unsafe behavior demands rigorous evaluation. While…

Artificial Intelligence · Computer Science 2026-02-18 Sanidhya Vijayvargiya , Aditya Bharat Soni , Xuhui Zhou , Zora Zhiruo Wang , Nouha Dziri , Graham Neubig , Maarten Sap

Computer-Using Agents (CUAs) are rapidly extending large language models (LLMs) beyond text-based reasoning toward action execution in more complex environments, such as web browsers and graphical user interfaces (GUIs). However, existing…

The rapid advancement of Large Language Models (LLMs) has stimulated interest in multi-agent collaboration for addressing complex medical tasks. However, the practical advantages of multi-agent collaboration approaches remain insufficiently…

Artificial Intelligence · Computer Science 2025-10-31 Yinghao Zhu , Ziyi He , Haoran Hu , Xiaochen Zheng , Xichen Zhang , Zixiang Wang , Junyi Gao , Liantao Ma , Lequan Yu

Large Language Models (LLMs) show promise as data analysis agents, but existing benchmarks overlook the iterative nature of the field, where experts' decisions evolve with deeper insights of the dataset. To address this, we introduce…

Computation and Language · Computer Science 2025-06-09 Hanyu Li , Haoyu Liu , Tingyu Zhu , Tianyu Guo , Zeyu Zheng , Xiaotie Deng , Michael I. Jordan

Agent technology, a new paradigm in software engineering, has received attention from research and industry since 1990s. However, it is still not used widely to date because it requires expertise on both programming and agent technology;…

Multiagent Systems · Computer Science 2016-01-26 Siyao Li

Generalist multimodal agents are expected to unify perception, language, and control - operating robustly across diverse real world domains. However, current evaluation practices remain fragmented across isolated benchmarks, making it…

Can a single LLM-based optimization system match specialized tools across fundamentally different domains? We show that when optimization problems are formulated as improving a text artifact evaluated by a scoring function, a single…

Large language model (LLM)-based agents that reason, plan, and act through tools, memory, and structured interaction are emerging as a promising paradigm for automating complex workflows. Recent systems such as OpenClaw and Claude Code…

Information Retrieval · Computer Science 2026-05-27 Yingli Zhou , Wang Shu , Yaodong Su , Wenchuan Du , Yixiang Fang , Xuemin Lin

Intelligent agents stand out as a potential path toward artificial general intelligence (AGI). Thus, researchers have dedicated significant effort to diverse implementations for them. Benefiting from recent progress in large language models…

Artificial Intelligence · Computer Science 2024-01-09 Yuheng Cheng , Ceyao Zhang , Zhengwen Zhang , Xiangrui Meng , Sirui Hong , Wenhao Li , Zihao Wang , Zekai Wang , Feng Yin , Junhua Zhao , Xiuqiang He

Multi-agent systems (MAS) decompose complex tasks and delegate subtasks to different large language model (LLM) agents and tools. Prior studies have reported the superior accuracy performance of MAS across diverse domains, enabled by…

Multiagent Systems · Computer Science 2025-05-27 Mingyan Gao , Yanzi Li , Banruo Liu , Yifan Yu , Phillip Wang , Ching-Yu Lin , Fan Lai

Agents based on Large Language Models (LLMs) have shown promise for performing sophisticated software engineering tasks autonomously. In addition, there has been progress towards developing agents that can perform parts of the research…

Computation and Language · Computer Science 2026-04-23 Nicholas Edwards , Yukyung Lee , Yujun Audrey Mao , Yulu Qin , Sebastian Schuster , Najoung Kim

We examine the capability of Multimodal Large Language Models (MLLMs) to tackle diverse domains that extend beyond the traditional language and vision tasks these models are typically trained on. Specifically, our focus lies in areas such…

Machine Learning · Computer Science 2024-12-12 Andrew Szot , Bogdan Mazoure , Omar Attia , Aleksei Timofeev , Harsh Agrawal , Devon Hjelm , Zhe Gan , Zsolt Kira , Alexander Toshev
‹ Prev 1 3 4 5 6 7 10 Next ›