English
Related papers

Related papers: LAMS: LLM-Driven Automatic Mode Switching for Assi…

200 papers

In dynamic environments such as warehouses, hospitals, and homes, robots must seamlessly transition between gross motion and precise manipulations to complete complex tasks. However, current Vision-Language-Action (VLA) frameworks, largely…

Adaptive Traffic Signal Control (ATSC) aims to optimize traffic flow and minimize delays by adjusting traffic lights in real time. Recent advances in Multi-agent Reinforcement Learning (MARL) have shown promise for ATSC, yet existing…

Robotics · Computer Science 2026-03-26 Yifeng Zhang , Peizhuo Li , Tingguang Zhou , Mingfeng Fan , Guillaume Sartoretti

Telerobotic surgery often relies on a fixed motion scaling factor (MSF) to map the surgeon's hand motions to robotic instruments, but this introduces a trade-off between precision and efficiency: small MSF enables delicate manipulation but…

Robotics · Computer Science 2025-10-31 Jeonghyeon Yoon , Sanghyeok Park , Hyojae Park , Cholin Kim , Michael C. Yip , Minho Hwang

Multimodal large language models (MLLMs) have shown remarkable capabilities in cross-modal understanding and reasoning, offering new opportunities for intelligent assistive systems, yet existing systems still struggle with risk-aware…

Robotics · Computer Science 2026-04-08 Renjun Gao

Recent studies provide large language models (LLMs) with textual task-solving experiences via prompts to improve their performance. However, previous methods rely on substantial human labor or time to gather such experiences for each task,…

Computation and Language · Computer Science 2025-05-30 Jinglong Gao , Xiao Ding , Lingxiao Zou , Bibo Cai , Bing Qin , Ting Liu

This paper introduces an innovative control approach for teleoperating a robot in close proximity to a human operator, which could be useful to control robots embedded on wheelchairs. The method entails establishing a virtual connection…

Robotics · Computer Science 2024-06-14 Alexis Poignant , Nathanaël Jarrassé , Guillaume Morel

In recent years, the integration of large language models (LLMs) has revolutionized the field of robotics, enabling robots to communicate, understand, and reason with human-like proficiency. This paper explores the multifaceted impact of…

Robotics · Computer Science 2024-08-16 Yeseung Kim , Dohyun Kim , Jieun Choi , Jisang Park , Nayoung Oh , Daehyung Park

A flurry of recent work has demonstrated that pre-trained large language models (LLMs) can be effective task planners for a variety of single-robot tasks. The planning performance of LLMs is significantly improved via prompting techniques,…

Robotics · Computer Science 2024-03-25 Yongchao Chen , Jacob Arkin , Yang Zhang , Nicholas Roy , Chuchu Fan

Autonomous robots operating in open environments need the ability to continuously handle tasks that are not covered by predefined local methods. However, existing approaches often rely on repeated large-language-model (LLM) interaction for…

Robotics · Computer Science 2026-04-27 Hong Su

As AI continues to advance, there is a growing demand for systems that go beyond language-based assistance and move toward intelligent agents capable of performing real-world actions. This evolution requires the transition from traditional…

Alignment of Large Language Models (LLMs) is the ability to satisfy desired objectives during generation, which is critical for trustworthy deployment. In practice, alignment is often operationalized through multiple objectives such as…

Computation and Language · Computer Science 2026-05-19 Gautam Siddharth Kashyap , Mark Dras , Usman Naseem

The future of conversational agents will provide users with personalized information responses. However, a significant challenge in developing models is the lack of large-scale dialogue datasets that span multiple sessions and reflect…

Information Retrieval · Computer Science 2024-05-07 Hideaki Joko , Shubham Chatterjee , Andrew Ramsay , Arjen P. de Vries , Jeff Dalton , Faegheh Hasibi

We present an assistance system that reasons about a human's intended actions during robot teleoperation in order to provide appropriate corrections for unintended behavior. We model the human's physical interaction with a control interface…

Robotics · Computer Science 2020-11-09 Deepak Gopinath , Mahdieh Nejati Javaremi , Brenna D. Argall

We propose LLM-DaaS, a novel Drone-as-a-Service (DaaS) framework that leverages Large Language Models (LLMs) to transform free-text user requests into structured, actionable DaaS operation tasks. Our approach addresses the key challenge of…

Artificial Intelligence · Computer Science 2024-12-17 Lillian Wassim , Kamal Mohamed , Ali Hamdi

In recent years, reinforcement learning and imitation learning have shown great potential for controlling humanoid robots' motion. However, these methods typically create simulation environments and rewards for specific tasks, resulting in…

Robotics · Computer Science 2024-08-01 Jingkai Sun , Qiang Zhang , Yiqun Duan , Xiaoyang Jiang , Chong Cheng , Renjing Xu

Many robotic platforms expose an API through which external software can command their actuators and read their sensors. However, transitioning from these low-level interfaces to high-level autonomous behaviour requires a complicated…

The rise of Large Language Models (LLMs) has impacted research in robotics and automation. While progress has been made in integrating LLMs into general robotics tasks, a noticeable void persists in their adoption in more specific domains…

Robotics · Computer Science 2025-01-30 Sadra Zargarzadeh , Maryam Mirzaei , Yafei Ou , Mahdi Tavakoli

A robot in a human-centric environment needs to account for the human's intent and future motion in its task and motion planning to ensure safe and effective operation. This requires symbolic reasoning about probable future actions and the…

Robotics · Computer Science 2023-11-01 Moritz A. Graule , Volkan Isler

Large Vision-Language-Action (VLA) models, leveraging powerful pre trained Vision-Language Models (VLMs) backends, have shown promise in robotic control due to their impressive generalization ability. However, the success comes at a cost.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Jianke Zhang , Yanjiang Guo , Xiaoyu Chen , Yen-Jen Wang , Yucheng Hu , Chengming Shi , Jianyu Chen

In autonomous exploration tasks, robots are required to explore and map unknown environments while efficiently planning in dynamic and uncertain conditions. Given the significant variability of environments, human operators often have…

Robotics · Computer Science 2025-03-11 Shuhao Liao , Xuxin Lv , Yuhong Cao , Jeric Lew , Wenjun Wu , Guillaume Sartoretti