English
Related papers

Related papers: Many Episode Learning in a Modular Embodied Agent …

200 papers

The difficulty and expense of obtaining large-scale human responses make Large Language Models (LLMs) an attractive alternative and a promising proxy for human behavior. However, prior work shows that LLMs often produce homogeneous outputs…

Artificial Intelligence · Computer Science 2025-10-09 Manh Hung Nguyen , Sebastian Tschiatschek , Adish Singla

This work introduces an end-to-end graph-based agent for accelerating the computational efficiency of Benders Decomposition. The agent's policy is parameterized by a graph neural network which takes as input a bipartite graph representation…

Optimization and Control · Mathematics 2025-11-18 Bernard T. Agyeman , Zhe Li , Ilias Mitrai , Prodromos Daoutidis

Autonomous agents driven by Large Language Models (LLMs) offer enormous potential for automation. Early proof of this technology can be found in various demonstrations of agents solving complex tasks, interacting with external systems to…

End-to-end approaches to autonomous driving commonly rely on expert demonstrations. Although humans are good drivers, they are not good coaches for end-to-end algorithms that demand dense on-policy supervision. On the contrary, automated…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Zhejun Zhang , Alexander Liniger , Dengxin Dai , Fisher Yu , Luc Van Gool

As information technology advances, education is moving from one-size-fits-all instruction toward personalized learning. However, most methods handle modeling, item selection, and feedback in isolation rather than as a closed loop. This…

Computation and Language · Computer Science 2025-10-28 Zhifeng Wang , Xinyue Zheng , Chunyan Zeng

Embodied systems, where generative autonomous agents engage with the physical world through integrated perception, cognition, action, and advanced reasoning powered by large language models (LLMs), hold immense potential for addressing…

Large Language Models (LLMs) often produce answers with a single chain-of-thought, which restricts their ability to explore reasoning paths or self-correct flawed outputs in complex tasks. In this paper, we introduce MALT (Multi-Agent LLM…

Multi-agent reinforcement learning (MARL) has long been a significant and everlasting research topic in both machine learning and control. With the recent development of (single-agent) deep RL, there is a resurgence of interests in…

Machine Learning · Computer Science 2019-12-10 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

To be helpful assistants, AI agents must be aware of their own capabilities and limitations. This includes knowing when to answer from parametric knowledge versus using tools, when to trust tool outputs, and when to abstain or hedge. Such…

Machine Learning · Computer Science 2025-09-01 Jacob Eisenstein , Reza Aghajani , Adam Fisch , Dheeru Dua , Fantine Huot , Mirella Lapata , Vicky Zayats , Jonathan Berant

Vision-language models (VLMs) have shown remarkable general capabilities, yet embodied agents built on them fail at complex tasks, often skipping critical steps, proposing invalid actions, and repeating mistakes. These failures arise from a…

Artificial Intelligence · Computer Science 2026-03-26 Bingqing Wei , Zhongyu Xia , Dingai Liu , Xiaoyu Zhou , Zhiwei Lin , Yongtao Wang

Autonomous agents powered by large language models (LLMs) have the potential to enhance human capabilities, assisting with digital tasks from sending emails to performing data analysis. The abilities of existing LLMs at such tasks are often…

Machine Learning · Computer Science 2025-01-22 Hongjin Su , Ruoxi Sun , Jinsung Yoon , Pengcheng Yin , Tao Yu , Sercan Ö. Arık

We introduce a novel category of GC-agents capable of functioning as both teachers and learners. Leveraging action-based demonstrations and language-based instructions, these agents enhance communication efficiency. We investigate the…

Artificial Intelligence · Computer Science 2023-09-28 Hugo Caselles-Dupré , Olivier Sigaud , Mohamed Chetouani

Embodied agents struggle to generalize to new environments, even when those environments share similar underlying structures to their training settings. Most current approaches to generating these training environments follow an open-loop…

Robotics · Computer Science 2026-02-09 Teresa Yeo , Dulaj Weerakoon , Dulanga Weerakoon , Archan Misra

Recent studies have presented compelling evidence that large language models (LLMs) can equip embodied agents with the self-driven capability to interact with the world, which marks an initial step toward versatile robotics. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Sipeng Zheng , Jiazheng Liu , Yicheng Feng , Zongqing Lu

The ultimate goal of embodied agents is to create collaborators that can interact with humans, not mere executors that passively follow instructions. This requires agents to communicate, coordinate, and adapt their actions based on human…

Robotics · Computer Science 2025-09-22 Xingyao Lin , Xinghao Zhu , Tianyi Lu , Sicheng Xie , Hui Zhang , Xipeng Qiu , Zuxuan Wu , Yu-Gang Jiang

The outstanding capabilities of large language models (LLMs) render them a crucial component in various autonomous agent systems. While traditional methods depend on the inherent knowledge of LLMs without fine-tuning, more recent approaches…

Artificial Intelligence · Computer Science 2024-12-10 Zhirui Deng , Zhicheng Dou , Yutao Zhu , Ji-Rong Wen , Ruibin Xiong , Mang Wang , Weipeng Chen

We consider the problem of robust multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents, mainly those trained in a centralized way, can be brittle because they can adopt policies that…

Multiagent Systems · Computer Science 2020-12-16 T. van der Heiden , C. Salge , E. Gavves , H. van Hoof

With the rise of online e-commerce platforms, more and more customers prefer to shop online. To sell more products, online platforms introduce various modules to recommend items with different properties such as huge discounts. A web page…

Machine Learning · Computer Science 2020-09-01 Xu He , Bo An , Yanghua Li , Haikai Chen , Rundong Wang , Xinrun Wang , Runsheng Yu , Xin Li , Zhirong Wang

An important aspect of developing conversational agents is to give a bot the ability to improve through communicating with humans and to learn from the mistakes that it makes. Most research has focused on learning from fixed training sets…

Artificial Intelligence · Computer Science 2017-01-17 Jiwei Li , Alexander H. Miller , Sumit Chopra , Marc'Aurelio Ranzato , Jason Weston

Existing AutoML systems have advanced the automation of machine learning (ML); however, they still require substantial manual configuration and expert input, particularly when handling multimodal data. We introduce MLZero, a novel…