English
Related papers

Related papers: RACAS: Controlling Diverse Robots With a Single Ag…

200 papers

The Abstraction and Reasoning Corpus (ARC) provides a compact laboratory for studying abstract reasoning, an ability central to human intelligence. Modern AI systems, including LLMs and ViTs, largely operate as sequence-of-behavior…

Artificial Intelligence · Computer Science 2026-01-21 Zhiguang Liu , Yi Shang

As robots are deployed in complex situations, engineers and end users must develop a holistic understanding of their behaviors, capabilities, and limitations. Some behaviors are directly optimized by the objective function. They often…

Robotics · Computer Science 2021-10-18 Yilun Zhou , Serena Booth , Nadia Figueroa , Julie Shah

The integration of Large Language Models (LLMs) into robotics has unlocked unprecedented capabilities in high-level task planning. However, most current systems operate in an open-loop fashion, where LLMs act as one-shot planners, rendering…

Robotics · Computer Science 2025-12-30 Anjali R. Menon , Rohit K. Sharma , Priya Singh , Chengyu Wang , Aurora M. Ferreira , Mateja Novak

There is a lack of autonomy on traditional Robot-Assisted Therapy systems interacting with children with autism. To overcome this limitation a supervised autonomous robot controller is being built. In this paper we present a multilayer…

We present a framework for intuitive robot programming by non-experts, leveraging natural language prompts and contextual information from the Robot Operating System (ROS). Our system integrates large language models (LLMs), enabling…

We present GestOS, a gesture-based operating system for high-level control of heterogeneous robot teams. Unlike prior systems that map gestures to fixed commands or single-agent actions, GestOS interprets hand gestures semantically and…

Robotics · Computer Science 2025-09-19 Artem Lykov , Oleg Kobzarev , Dzmitry Tsetserukou

In recent years, research in the area of human-robot interaction has focused on developing robots capable of understanding complex human instructions and performing tasks in dynamic and diverse environments. These systems have a wide range…

Robotics · Computer Science 2024-11-25 Simone Colombani , Dimitri Ognibene , Giuseppe Boccignone

Autonomous Driving Systems (ADSs) are revolutionizing transportation by reducing human intervention, improving operational efficiency, and enhancing safety. Large Language Models (LLMs) have been integrated into ADSs to support high-level…

Multiagent Systems · Computer Science 2025-10-15 Yaozu Wu , Dongyuan Li , Yankai Chen , Renhe Jiang , Henry Peng Zou , Wei-Chieh Huang , Yangning Li , Liancheng Fang , Zhen Wang , Philip S. Yu

Interest in semi-autonomous systems (SAS) is growing rapidly as a paradigm to deploy autonomous systems in domains that require occasional reliance on humans. This paradigm allows service robots or autonomous vehicles to operate at varying…

Artificial Intelligence · Computer Science 2020-03-18 Connor Basich , Justin Svegliato , Kyle Hollins Wray , Stefan Witwicki , Joydeep Biswas , Shlomo Zilberstein

Large Language Model (LLM)-based agents increasingly interact, collaborate, and delegate tasks to one another autonomously with minimal human interaction. Industry guidelines for agentic system governance emphasize the need for users to…

Cryptography and Security · Computer Science 2025-09-01 Georgios Syros , Anshuman Suri , Jacob Ginesin , Cristina Nita-Rotaru , Alina Oprea

The automation of chemical research through self-driving laboratories (SDLs) promises to accelerate scientific discovery, yet the reliability and granular performance of the underlying AI agents remain critical, under-examined challenges.…

Artificial Intelligence · Computer Science 2025-10-01 Gihan Panapitiya , Emily Saldanha , Heather Job , Olivia Hess

The prevailing paradigm in AI for physical systems (scaling general-purpose foundation models toward universal multimodal reasoning) confronts a fundamental barrier at the control interface. Recent benchmarks show that even frontier…

Artificial Intelligence · Computer Science 2026-05-21 Yoon Pyo Lee , Samrendra Roy , Jay Yoo , Kazuma Kobayashi , Sajedul Talukder , Seid Koric , Souvik Chakraborty , Syed Bahauddin Alam

Clinical data-driven research requires clinical expertise, programming skills, access to patient data, and extensive documentation, creating barriers and slowing the pace for clinicians and external researchers. To address this, we…

Computation and Language · Computer Science 2026-04-22 Taehun Kim , Hyeryun Park , Hyeonhoon Lee , Yushin Lee , Kyungsang Kim , Hyung-Chul Lee

Robotic systems lack a principled abstraction for organizing intelligence, capabilities, and execution in a unified manner. Existing approaches either couple skills within monolithic architectures or decompose functionality into loosely…

Robotics · Computer Science 2026-05-26 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

The impressive capabilities of Large Language Models (LLMs) have led to various efforts to enable robots to be controlled through natural language instructions, opening exciting possibilities for human-robot interaction The goal is for the…

Robotics · Computer Science 2024-03-19 Seif Ismail , Antonio Arbues , Ryan Cotterell , René Zurbrügg , Carmen Amo Alonso

Deploying agentic AI in regulated contexts requires principled reasoning about two design dimensions: agency (what the system can do) and autonomy (how much it acts without human involvement). Though often treated independently, they are…

Artificial Intelligence · Computer Science 2026-05-13 Damir Safin , Dian Balta

Known attempts to build autonomous robots rely on complex control architectures, often implemented with the Robot Operating System platform (ROS). Runtime adaptation is needed in these systems, to cope with component failures and with…

From ancient water wheels to robotic process automation (RPA), automation technology has evolved throughout history to liberate human beings from arduous tasks. Yet, RPA struggles with tasks needing human-like intelligence, especially in…

Multi-agent architectures built on large language models (LLMs) have demonstrated the potential to realize swarm intelligence through well-crafted collaboration. However, the substantial burden of manual orchestration inherently raises an…

Artificial Intelligence · Computer Science 2026-02-10 Rui Li , Zeyu Zhang , Xiaohe Bo , Quanyu Dai , Chaozhuo Li , Feng Wen , Xu Chen

Agentic AI represents a significant shift in how intelligence is applied within organizations, moving beyond AI-assisted tools toward autonomous systems capable of reasoning, decision-making, and coordinated action across workflows. As…