English
Related papers

Related papers: ParaView-MCP: An Autonomous Visualization Agent wi…

200 papers

Standard protocols such as the Model Context Protocol (MCP) that allow LLMs to connect to tools have recently boosted "agentic" AI applications, which, powered by LLMs' planning capabilities, promise to solve complex tasks with the access…

Information Retrieval · Computer Science 2026-04-10 Daniel Dobriy , Frederik Bauer , Amr Azzam , Debayan Banerjee , Axel Polleres

Tool calling extends large language models (LLMs) by enabling grounded interaction with external executable interfaces, thereby supporting environment-coupled problem solving. However, mainstream in-context learning (ICL) approaches…

Artificial Intelligence · Computer Science 2026-05-29 Zekai Yu , Qi Meng , Qizhi Chu , Yu Hao , Chuan Shi , Cheng Yang

The integration of Large Language Models (LLMs) into network operations (AIOps) is hindered by two fundamental challenges: the stochastic grounding problem, where LLMs struggle to reliably parse unstructured, vendor-specific CLI output, and…

Networking and Internet Architecture · Computer Science 2026-02-02 Devansh Lodha , Mohit Panchal , Sameer G. Kulkarni

The rise of Large Language Models (LLMs) and generative visual analytics systems has transformed data-driven insights, yet significant challenges persist in accurately interpreting users' analytical and interaction intents. While language…

Human-Computer Interaction · Computer Science 2025-04-17 Juntong Chen , Jiang Wu , Jiajing Guo , Vikram Mohanty , Xueming Li , Jorge Piazentin Ono , Wenbin He , Liu Ren , Dongyu Liu

The unprecedented advancements in Multimodal Large Language Models (MLLMs) have demonstrated strong potential in interacting with humans through both language and visual inputs to perform downstream tasks such as visual question answering…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Wenjia Xu , Zijian Yu , Boyang Mu , Zhiwei Wei , Yuanben Zhang , Guangzuo Li , Jiuniu Wang , Mugen Peng

The development of large language models (LLMs) has significantly enhanced the capabilities of multimodal LLMs (MLLMs) as general assistants. However, lack of user-specific knowledge still restricts their application in human's daily life.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Haoran Hao , Jiaming Han , Changsheng Li , Yu-Feng Li , Xiangyu Yue

This paper presents a Large Language Model (LLM) based conversational agent system designed to enhance human-machine collaboration in Machine Learning Operations (MLOps). We introduce the Swarm Agent, an extensible architecture that…

Artificial Intelligence · Computer Science 2025-11-11 George Fatouros , Georgios Makridis , George Kousiouris , John Soldatos , Anargyros Tsadimas , Dimosthenis Kyriazis

The advent of immersive Virtual Reality applications has transformed various domains, yet their integration with advanced artificial intelligence technologies like Visual Language Models remains underexplored. This study introduces a…

Robotics · Computer Science 2024-08-06 Mikhail Konenkov , Artem Lykov , Daria Trinitatova , Dzmitry Tsetserukou

Large language models (LLMs) are being increasingly used for planning in orchestrated multi-agent systems. However, existing LLM-based approaches often fall short of human expectations and, critically, lack effective mechanisms for users to…

Human-Computer Interaction · Computer Science 2025-09-30 Hannah Kim , Kushan Mitra , Chen Shen , Dan Zhang , Estevam Hruschka

This paper presents a novel design of a multi-agent system framework that applies large language models (LLMs) to automate the parametrization of simulation models in digital twins. This framework features specialized LLM agents tasked with…

Artificial Intelligence · Computer Science 2024-07-23 Yuchen Xia , Daniel Dittler , Nasser Jazdi , Haonan Chen , Michael Weyrich

Large language models (LLMs) are evolving into agentic systems that reason, plan, and operate external tools. The Model Context Protocol (MCP) is a key enabler of this transition, offering a standardized interface for connecting LLMs with…

Computation and Language · Computer Science 2026-03-06 Xuanjun Zong , Zhiqi Shen , Lei Wang , Yunshi Lan , Chao Yang

The Model Context Protocol (MCP) has recently emerged as a standardized interface for connecting language models with external tools and data. As the ecosystem rapidly expands, the lack of a structured, comprehensive view of existing MCP…

Cryptography and Security · Computer Science 2025-07-01 Zhiwei Lin , Bonan Ruan , Jiahao Liu , Weibo Zhao

Software robots have long been used in Robotic Process Automation (RPA) to automate mundane and repetitive computer tasks. With the advent of Large Language Models (LLMs) and their advanced reasoning capabilities, these agents are now able…

Artificial Intelligence · Computer Science 2024-12-30 Junhee Cho , Jihoon Kim , Daseul Bae , Jinho Choo , Youngjune Gwon , Yeong-Dae Kwon

True intelligence requires active capability acquisition, yet current LLM agents inject pre-defined tool schemas into prompts, reducing models to passive selectors and falling short of robust general-purpose agency. We introduce MCP-Zero,…

Artificial Intelligence · Computer Science 2025-06-25 Xiang Fei , Xiawu Zheng , Hao Feng

Large language model (LLM)-based agents are increasingly used to perform complex, multi-step workflows in regulated settings such as compliance and due diligence. However, many agentic architectures rely primarily on prompt engineering of a…

Artificial Intelligence · Computer Science 2026-02-03 Ananya Joshi , Michael Rudow

The potential of automatic task-solving through Large Language Model (LLM)-based multi-agent collaboration has recently garnered widespread attention from both the research community and industry. While utilizing natural language to…

Human-Computer Interaction · Computer Science 2024-04-19 Bo Pan , Jiaying Lu , Ke Wang , Li Zheng , Zhen Wen , Yingchaojie Feng , Minfeng Zhu , Wei Chen

We present a Collaborative Agent-Based Framework for Multi-Image Reasoning. Our approach tackles the challenge of interleaved multimodal reasoning across diverse datasets and task formats by employing a dual-agent system: a language-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Angelos Vlachos , Giorgos Filandrianos , Maria Lymperaiou , Nikolaos Spanos , Ilias Mitsouras , Vasileios Karampinis , Athanasios Voulodimos

The application of the Multi-modal Large Language Models (MLLMs) in medical clinical scenarios remains underexplored. Previous benchmarks only focus on the capacity of the MLLMs in medical visual question-answering (VQA) or report…

Computation and Language · Computer Science 2024-08-19 Hongcheng Liu , Yusheng Liao , Siqv Ou , Yuhao Wang , Heyang Liu , Yanfeng Wang , Yu Wang

We introduce Orion, a visual agent that integrates vision-based reasoning with tool-augmented execution to achieve powerful, precise, multi-step visual intelligence across images, video, and documents. Unlike traditional vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 N Dinesh Reddy , Dylan Snyder , Lona Kiragu , Mirajul Mohin , Shahrear Bin Amin , Sudeep Pillai

This paper establishes a fundamental convergence: Schema-Guided Dialogue (SGD) and the Model Context Protocol (MCP) represent two manifestations of a unified paradigm for deterministic, auditable LLM-agent interaction. SGD, designed for…

Artificial Intelligence · Computer Science 2026-03-06 Andreas Schlapbach