English
Related papers

Related papers: Explainable Behavior Cloning: Teaching Large Langu…

200 papers

We propose a novel approach for training large language models (LLMs) to adhere to objectives defined within a latent embedding space. Our method leverages reinforcement learning (RL), treating a pre-trained LLM as an environment. Our…

Computation and Language · Computer Science 2024-10-29 Guy Tennenholtz , Yinlam Chow , Chih-Wei Hsu , Lior Shani , Ethan Liang , Craig Boutilier

The widespread availability of Large Language Models (LLMs) within Integrated Development Environments (IDEs) has led to their speedy adoption. Conversational interactions with LLMs enable programmers to obtain natural language explanations…

Human-Computer Interaction · Computer Science 2024-02-12 Bhavya Chopra , Yasharth Bajpai , Param Biyani , Gustavo Soares , Arjun Radhakrishna , Chris Parnin , Sumit Gulwani

We propose LEO-RobotAgent, a general-purpose language-driven intelligent agent framework for robots. Under this framework, LLMs can operate different types of robots to complete unpredictable complex tasks across various scenarios. This…

Robotics · Computer Science 2026-04-16 Lihuang Chen , Xiangyu Luo , Jun Meng

Vision-language models (VLMs) have shown remarkable general capabilities, yet embodied agents built on them fail at complex tasks, often skipping critical steps, proposing invalid actions, and repeating mistakes. These failures arise from a…

Artificial Intelligence · Computer Science 2026-03-26 Bingqing Wei , Zhongyu Xia , Dingai Liu , Xiaoyu Zhou , Zhiwei Lin , Yongtao Wang

Large language model (LLM)-based agents have demonstrated strong capabilities in complex reasoning and problem solving through multi-step interactions, yet most deployed agents remain behaviorally static, with knowledge acquired during…

Artificial Intelligence · Computer Science 2026-05-19 Yuxin Jin , Siyuan Zhang , Hanchen Wang , Lu Qin , Ying Zhang , Wenjie Zhang

In recent developments within the research community, the integration of Large Language Models (LLMs) in creating fully autonomous agents has garnered significant interest. Despite this, LLM-based agents frequently demonstrate notable…

Computation and Language · Computer Science 2024-02-21 Xueyang Feng , Zhi-Yuan Chen , Yujia Qin , Yankai Lin , Xu Chen , Zhiyuan Liu , Ji-Rong Wen

This paper proposes EvoAgent - an evolvable large language model (LLM) agent framework that integrates structured skill learning with a hierarchical sub-agent delegation mechanism. EvoAgent models skills as multi-file structured capability…

Artificial Intelligence · Computer Science 2026-04-27 Aimin Zhang , Jiajing Guo , Fuwei Jia , Chen Lv , Boyu Wang , Fangzheng Li

Computational psychiatry faces a fundamental trade-off: traditional reinforcement learning (RL) models offer interpretability but lack behavioral realism, while large language model (LLM) agents generate realistic behaviors but lack…

Artificial Intelligence · Computer Science 2026-03-06 Zuo Fei , Kezhi Wang , Xiaomin Chen , Yizhou Huang

Intelligent systems have traditionally been designed as tools rather than collaborators, often lacking critical characteristics that collaboration partnerships require. Recent advances in large language model (LLM) agents open new…

Human-Computer Interaction · Computer Science 2026-02-17 Bingsheng Yao , Jiaju Chen , Chaoran Chen , April Wang , Toby Jia-jun Li , Dakuo Wang

Large language models (LLMs) have shown remarkable capabilities in various natural language understanding tasks. With only a few demonstration examples, these LLMs can quickly adapt to target tasks without expensive gradient updates. Common…

Computation and Language · Computer Science 2023-11-14 Yue Yu , Jiaming Shen , Tianqi Liu , Zhen Qin , Jing Nathan Yan , Jialu Liu , Chao Zhang , Michael Bendersky

Embodied decision-making enables agents to translate high-level goals into executable actions through continuous interactions within the physical world, forming a cornerstone of general-purpose embodied intelligence. Large language models…

Artificial Intelligence · Computer Science 2025-10-15 Zixing Lei , Sheng Yin , Yichen Xiong , Yuanzhuo Ding , Wenhao Huang , Yuxi Wei , Qingyao Xu , Yiming Li , Weixin Li , Yunhong Wang , Siheng Chen

Large Language Models (LLMs) have gained popularity in task planning for long-horizon manipulation tasks. To enhance the validity of LLM-generated plans, visual demonstrations and online videos have been widely employed to guide the…

Robotics · Computer Science 2025-03-12 Kejia Chen , Zheng Shen , Yue Zhang , Lingyun Chen , Fan Wu , Zhenshan Bing , Sami Haddadin , Alois Knoll

The recent surge in research interest in applying large language models (LLMs) to decision-making tasks has flourished by leveraging the extensive world knowledge embedded in LLMs. While there is a growing demand to tailor LLMs for custom…

Machine Learning · Computer Science 2024-12-23 Andrew Zhao , Daniel Huang , Quentin Xu , Matthieu Lin , Yong-Jin Liu , Gao Huang

Recent advancements in large language models (LLMs) provide a more effective pathway for upgrading brain-computer interface (BCI) technology in terms of user interaction. The widespread adoption of BCIs in daily application scenarios is…

Human-Computer Interaction · Computer Science 2025-02-19 Jing Jin , Yutao Zhang , Ruitian Xu , Yixin Chen

Due to privacy concerns, open dialogue datasets for mental health are primarily generated through human or AI synthesis methods. However, the inherent implicit nature of psychological processes, particularly those of clients, poses…

Human-Computer Interaction · Computer Science 2025-11-18 Lixiu Wu , Yuanrong Tang , Qisen Pan , Xianyang Zhan , Yucheng Han , Lanxi Xiao , Tianhong Wang , Chen Zhong , Jiangtao Gong

In recent years, the rapid development of Large Language Models (LLMs) has significantly enhanced natural language understanding and human-computer interaction, creating new opportunities in the field of robotics. However, the integration…

Robotics · Computer Science 2026-01-06 Shenqi Lu , Liangwei Zhang

Large language models (LLMs) have opened new opportunities for automated mobile app exploration, an important and challenging problem that used to suffer from the difficulty of generating meaningful UI interactions. However, existing…

Software Engineering · Computer Science 2025-05-19 Shanhui Zhao , Hao Wen , Wenjie Du , Cheng Liang , Yunxin Liu , Xiaozhou Ye , Ye Ouyang , Yuanchun Li

Large language models (LLMs)-empowered autonomous agents are transforming both digital and physical environments by enabling adaptive, multi-agent collaboration. While these agents offer significant opportunities across domains such as…

Artificial Intelligence · Computer Science 2026-05-21 Qinnan Hu , Yuntao Wang , Yuan Gao , Zhou Su , Linkang Du , Qichao Xu

Large Language Models (LLMs) have demonstrated potential in Vision-and-Language Navigation (VLN) tasks, yet current applications face challenges. While LLMs excel in general conversation scenarios, they struggle with specialized navigation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yunzhe Xu , Yiyuan Pan , Zhe Liu , Hesheng Wang

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell