English
Related papers

Related papers: BeSimulator: A Large Language Model Powered Text-b…

200 papers

Recent works have shown great potentials of Large Language Models (LLMs) in robot task and motion planning (TAMP). Current LLM approaches generate text- or code-based reasoning chains with sub-goals and action plans. However, they do not…

Robotics · Computer Science 2025-08-11 Yongchao Chen , Yilun Hao , Yang Zhang , Chuchu Fan

Large language models (LLMs) provide excellent text-generation capabilities, but standard prompting and generation methods generally do not lead to intentional or goal-directed agents and might necessitate considerable prompt tuning. This…

Computation and Language · Computer Science 2023-12-01 Marwa Abdulhai , Isadora White , Charlie Snell , Charles Sun , Joey Hong , Yuexiang Zhai , Kelvin Xu , Sergey Levine

Autonomous driving (AD) testing constitutes a critical methodology for assessing performance benchmarks prior to product deployment. The creation of segmented scenarios within a simulated environment is acknowledged as a robust and…

Software Engineering · Computer Science 2025-03-06 Xuan Cai , Xuesong Bai , Zhiyong Cui , Danmu Xie , Daocheng Fu , Haiyang Yu , Yilong Ren

In this paper, we introduce LGTM, a novel Local-to-Global pipeline for Text-to-Motion generation. LGTM utilizes a diffusion-based architecture and aims to address the challenge of accurately translating textual descriptions into…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Haowen Sun , Ruikun Zheng , Haibin Huang , Chongyang Ma , Hui Huang , Ruizhen Hu

Queueing simulation studies often require substantial manual effort to translate conceptual system descriptions into executable programs and to verify that the implemented mechanisms match the intended queueing logic. Although large…

Computation and Language · Computer Science 2026-05-06 Jun-Qi Chen , Kun Zhang , Rui Zheng , Ying Zhong

Finding ways to accelerate text input for individuals with profound motor impairments has been a long-standing area of research. Closing the speed gap for augmentative and alternative communication (AAC) devices such as eye-tracking…

Large Language Models (\textbf{LLMs}), e.g. ChatGPT, have been widely adopted in real-world dialogue applications. However, LLMs' robustness, especially in handling long complex dialogue sessions, including frequent motivation transfer,…

Computation and Language · Computer Science 2025-09-16 Chenghao Yang , Yinbo Luo , Zhoufutu Wen , Qi Chu , Tao Gong , Longxiang Liu , Kaiyuan Zhang , Jianpeng Jiao , Ge Zhang , Wenhao Huang , Nenghai Yu

As Large Language Models (LLMs) evolve from static dialogue interfaces to autonomous general agents, effective memory is paramount to ensuring long-term consistency. However, existing benchmarks primarily focus on casual conversation or…

Computation and Language · Computer Science 2026-01-13 Haonan Bian , Zhiyuan Yao , Sen Hu , Zishan Xu , Shaolei Zhang , Yifu Guo , Ziliang Yang , Xueran Han , Huacan Wang , Ronghao Chen

Human communication is a complex and diverse process that not only involves multiple factors such as language, commonsense, and cultural backgrounds but also requires the participation of multimodal information, such as speech. Large…

Computation and Language · Computer Science 2024-01-09 Dong Zhang , Zhaowei Li , Pengyu Wang , Xin Zhang , Yaqian Zhou , Xipeng Qiu

In recent years, the integration of large language models (LLMs) has revolutionized the field of robotics, enabling robots to communicate, understand, and reason with human-like proficiency. This paper explores the multifaceted impact of…

Robotics · Computer Science 2024-08-16 Yeseung Kim , Dohyun Kim , Jieun Choi , Jisang Park , Nayoung Oh , Daehyung Park

We introduce a simple approach that uses a large language model (LLM) to automatically implement a fully interpretable rule-based data-to-text system in pure Python. Experimental evaluation on the WebNLG dataset showed that such a…

Computation and Language · Computer Science 2025-03-03 Jędrzej Warczyński , Mateusz Lango , Ondrej Dusek

There has been a growing interest in developing learner models to enhance learning and teaching experiences in educational environments. However, existing works have primarily focused on structured environments relying on meticulously…

Machine Learning · Computer Science 2024-05-01 Bahar Radmehr , Adish Singla , Tanja Käser

This paper introduces LLM-MARS, first technology that utilizes a Large Language Model based Artificial Intelligence for Multi-Agent Robot Systems. LLM-MARS enables dynamic dialogues between humans and robots, allowing the latter to generate…

Large language models (LLMs) have been extensively studied for tasks like math competitions, complex coding, and scientific reasoning, yet their ability to accurately represent and simulate physical scenarios via code remains underexplored.…

Machine Learning · Computer Science 2026-02-12 Yanan Wang , Renxi Wang , Yongxin Wang , Xuezhi Liang , Fajri Koto , Timothy Baldwin , Xiaodan Liang , Haonan Li

Assistive agents should not only take actions on behalf of a human, but also step out of the way and cede control when there are important decisions to be made. However, current methods for building assistive agents, whether via mimicking…

Artificial Intelligence · Computer Science 2025-10-17 Evan Ellis , Vivek Myers , Jens Tuyls , Sergey Levine , Anca Dragan , Benjamin Eysenbach

This paper presents a novel design of a multi-agent system framework that applies large language models (LLMs) to automate the parametrization of simulation models in digital twins. This framework features specialized LLM agents tasked with…

Artificial Intelligence · Computer Science 2024-07-23 Yuchen Xia , Daniel Dittler , Nasser Jazdi , Haonan Chen , Michael Weyrich

Computational social experiments, which typically employ agent-based modeling to create testbeds for piloting social experiments, not only provide a computational solution to the major challenges faced by traditional experimental methods,…

Computers and Society · Computer Science 2025-08-13 Jinghua Piao , Yuwei Yan , Nian Li , Jun Zhang , Yong Li

Large Language Models (LLMs) are increasingly relied upon for coding tasks, yet in most scenarios it is assumed that all relevant information can be either accessed in context or matches their training data. We posit that LLMs can benefit…

Language model (LM) pre-training is useful in many language processing tasks. But can pre-trained LMs be further leveraged for more general machine learning problems? We propose an approach for using LMs to scaffold learning and…

Large Language Models (LLMs) trained using massive text datasets have recently shown promise in generating action plans for robotic agents from high level text queries. However, these models typically do not consider the robot's…

Robotics · Computer Science 2023-05-03 Maitrey Gramopadhye , Daniel Szafir