English
Related papers

Related papers: RoboNeuron: A Middle-Layer Infrastructure for Agen…

200 papers

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for open-world robot manipulation, but their practical deployment is often constrained by cost: billion-scale VLM backbones and iterative diffusion/flow-based action…

The field of Artificial Intelligence is undergoing a transition from Generative AI -- probabilistic generation of text and images -- to Agentic AI, in which autonomous systems execute actions within external environments on behalf of users.…

Artificial Intelligence · Computer Science 2026-03-02 Sheng Cao , Zhao Chang , Chang Li , Hannan Li , Liyao Fu , Ji Tang

Recent advances in LLM Multi-Agent Systems enable scalable orchestration of sub-agents, each coordinating hundreds or thousands of tools or Model Context Protocol (MCP) servers. However, existing retrieval methods typically match queries…

Computation and Language · Computer Science 2025-11-05 Elias Lumer , Faheem Nizar , Anmol Gulati , Pradeep Honaganahalli Basavaraju , Vamse Kumar Subbiah

Understanding and following directions provided by humans can enable robots to navigate effectively in unknown situations. We present FollowNet, an end-to-end differentiable neural architecture for learning multi-modal navigation policies.…

Robotics · Computer Science 2018-09-20 Pararth Shah , Marek Fiser , Aleksandra Faust , J. Chase Kew , Dilek Hakkani-Tur

Language Models and Vision Language Models have recently demonstrated unprecedented capabilities in terms of understanding human intentions, reasoning, scene understanding, and planning-like behaviour, in text form, among many others. In…

The advancement of robotic systems has revolutionized numerous industries, yet their operation often demands specialized technical knowledge, limiting accessibility for non-expert users. This paper introduces ROSA (Robot Operating System…

Navigating in unseen environments is crucial for mobile robots. Enhancing them with the ability to follow instructions in natural language will further improve navigation efficiency in unseen cases. However, state-of-the-art (SOTA)…

Robotics · Computer Science 2023-10-18 Chengguang Xu , Hieu T. Nguyen , Christopher Amato , Lawson L. S. Wong

Large language model (LLM) agents have increasingly advanced service applications, such as booking flight tickets. However, these service agents suffer from unreliability in long-horizon tasks, as they often produce policy violations, tool…

Artificial Intelligence · Computer Science 2026-05-13 Zixu Yang , Hang Zheng , Nan Jiang , Zhiyang Tang , Situo Zhang , Xiaobao Wu , Lu Chen , Kai Yu

Recent multi-agent frameworks built upon large language models (LLMs) have demonstrated remarkable capabilities in complex task planning. However, in real-world enterprise environments, business workflows are typically composed through…

Multiagent Systems · Computer Science 2025-08-28 Yiming Xiong , Jian Wang , Bing Li , Yuhan Zhu , Yuqi Zhao

Robots deployed in unstructured human environments must frequently execute long-horizon missions, such as find the mug, then the chair, then the printer, under strict operational constraints. While contemporary zero-shot Object Navigation…

Robotics · Computer Science 2026-05-19 Xi Lin , Jiayi Li , Kangyi Wu , Jiaqiao Tang , Qingrong He , Lin Zhao

Agent based modelling (ABM) is a computational approach to modelling complex systems by specifying the behaviour of autonomous decision-making components or agents in the system and allowing the system dynamics to emerge from their…

Artificial Intelligence · Computer Science 2023-05-22 Leo Ardon , Jared Vann , Deepeka Garg , Tom Spooner , Sumitra Ganesh

The deployment of artificial intelligence models at the edge is increasingly critical for autonomous robots operating in GPS-denied environments where local, resource-efficient reasoning is essential. This work demonstrates the feasibility…

Robotics · Computer Science 2025-11-11 Justin Williams , Kishor Datta Gupta , Roy George , Mrinmoy Sarkar

Vision-Language-Action (VLA) models have emerged as a promising paradigm for general-purpose robotic manipulation, leveraging large-scale pre-training to achieve strong performance. The field has rapidly evolved with additional spatial…

Robotics · Computer Science 2026-02-23 Yuankai Luo , Woping Chen , Tong Liang , Baiqiao Wang , Zhenguo Li

Heterogeneous hardware and dynamic workloads worsen long-standing OS bottlenecks in scalability, adaptability, and manageability. At the same time, advances in machine learning (ML), large language models (LLMs), and agent-based methods…

Operating Systems · Computer Science 2025-11-12 Yifan Zhang , Xinkui Zhao , Ziying Li , Guanjie Cheng , Jianwei Yin , Lufei Zhang , Zuoning Chen

Programming robot behavior in a complex world faces challenges on multiple levels, from dextrous low-level skills to high-level planning and reasoning. Recent pre-trained Large Language Models (LLMs) have shown remarkable reasoning ability…

Robotics · Computer Science 2023-10-12 Xufeng Zhao , Mengdi Li , Cornelius Weber , Muhammad Burhan Hafez , Stefan Wermter

A Multi Robot System (MRS) is the infrastructure of an intelligent cyberphysical system, where the robots understand the need of the human, and hence cooperate together to fulfill this need. Modeling an MRS is a crucial aspect of designing…

Artificial Intelligence · Computer Science 2024-11-06 Ahmed R. Sadik , Christian Goerick , Manuel Muehlig

With the advancement of Multimodal Large Language Models (MLLM), LLM-driven visual agents are increasingly impacting software interfaces, particularly those with graphical user interfaces. This work introduces a novel LLM-based multimodal…

Human-Computer Interaction · Computer Science 2025-09-18 Yanda Li , Chi Zhang , Wenjia Jiang , Wanqi Yang , Bin Fu , Pei Cheng , Xin Chen , Ling Chen , Yunchao Wei

The ability to navigate and interact with complex environments is central to real-world embodied agents, yet navigation in unseen environments remains challenging due to "experiential amnesia," where existing trajectory-driven or reactive…

Embodied intelligence is often studied through specialized models for individual tasks such as manipulation or navigation, resulting in fragmented capabilities and limited generalization across tasks, environments, and robot embodiments. In…

Robotic foundation models achieve strong generalization by leveraging internet-scale vision-language representations, but their massive computational cost creates a fundamental bottleneck: high inference latency. In dynamic environments,…

Robotics · Computer Science 2026-02-17 Noriaki Hirose , Catherine Glossop , Dhruv Shah , Sergey Levine