English
Related papers

Related papers: Offline Training of Language Model Agents with Fun…

200 papers

By formally defining the training processes of large language models (LLMs), which usually encompasses pre-training, supervised fine-tuning, and reinforcement learning with human feedback, within a single and unified machine learning…

Computation and Language · Computer Science 2024-02-14 Yang Liu , Peng Sun , Hang Li

Large Language Models (LLMs) based agents have demonstrated remarkable potential in autonomous task-solving across complex, open-ended environments. A promising approach for improving the reasoning capabilities of LLM agents is to better…

Computation and Language · Computer Science 2025-11-12 Siyu Xia , Zekun Xu , Jiajun Chai , Wentian Fan , Yan Song , Xiaohan Wang , Guojun Yin , Wei Lin , Haifeng Zhang , Jun Wang

Can emergent language models faithfully model the intelligence of decision-making agents? Though modern language models exhibit already some reasoning ability, and theoretically can potentially express any probable distribution over tokens,…

Machine Learning · Computer Science 2024-06-27 Wenhao Lu , Xufeng Zhao , Josua Spisak , Jae Hee Lee , Stefan Wermter

Recent research looks to harness the general knowledge and reasoning of large language models (LLMs) into agents that accomplish user-specified goals in interactive environments. Vision-language models (VLMs) extend LLMs to multi-modal data…

Machine Learning · Computer Science 2025-05-07 Jake Grigsby , Yuke Zhu , Michael Ryoo , Juan Carlos Niebles

Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as autonomous agents to do many tasks automatically. Recently,…

Computation and Language · Computer Science 2024-04-22 Taicheng Guo , Xiuying Chen , Yaqi Wang , Ruidi Chang , Shichao Pei , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

With recent advancements in natural language processing, Large Language Models (LLMs) have emerged as powerful tools for various real-world applications. Despite their prowess, the intrinsic generative abilities of LLMs may prove…

Artificial Intelligence · Computer Science 2025-12-30 Jingqing Ruan , Yihong Chen , Bin Zhang , Zhiwei Xu , Tianpeng Bao , Guoqing Du , Shiwei Shi , Hangyu Mao , Ziyue Li , Xingyu Zeng , Rui Zhao

While Large Language Model (LLM)-based agents can be used to create highly engaging interactive applications through prompting personality traits and contextual data, effectively assessing their personalities has proven challenging. This…

Human-Computer Interaction · Computer Science 2025-10-29 Eswari Jayakumar , Niladri Sekhar Dash , Debasmita Mukherjee

Large Action Models (LAMs) for AI Agents offer incredible potential but face challenges due to the need for high-quality training data, especially for multi-steps tasks that involve planning, executing tool calls, and responding to…

Reinforcement Learning (RL) in games has gained significant momentum in recent years, enabling the creation of different agent behaviors that can transform a player's gaming experience. However, deploying RL agents in production…

Artificial Intelligence · Computer Science 2025-07-01 António Afonso , Iolanda Leite , Alessandro Sestini , Florian Fuchs , Konrad Tollmar , Linus Gisslén

Large Language Model (LLM) agents are transforming education by automating complex pedagogical tasks and enhancing both teaching and learning processes. In this survey, we present a systematic review of recent advances in applying LLM…

Computers and Society · Computer Science 2026-02-05 Zhendong Chu , Shen Wang , Jian Xie , Tinghui Zhu , Yibo Yan , Jinheng Ye , Aoxiao Zhong , Xuming Hu , Jing Liang , Philip S. Yu , Qingsong Wen

This paper reviews the architecture and implementation methods of agents powered by large language models (LLMs). Motivated by the limitations of traditional LLMs in real-world tasks, the research aims to explore patterns to develop…

Artificial Intelligence · Computer Science 2025-10-13 Victor de Lamo Castrillo , Habtom Kahsay Gidey , Alexander Lenz , Alois Knoll

Large Language Models (LLMs) have transformed agent-agent and human-agent interaction by enabling software, physical, and simulation agents to communicate and deliberate through natural language. Yet fluent language use does not by itself…

Multiagent Systems · Computer Science 2026-05-05 Önder Gürcan , Moharram Challenger

Large Language Model (LLM) agents represent a promising shift in human-AI interaction, moving beyond passive prompt-response systems to autonomous agents capable of reasoning, planning, and goal-directed action. While LLM agents are…

Computation and Language · Computer Science 2026-02-06 Weiwen Liu , Jiarui Qin , Xu Huang , Xingshan Zeng , Yunjia Xi , Jianghao Lin , Chuhan Wu , Yasheng Wang , Lifeng Shang , Ruiming Tang , Defu Lian , Yong Yu , Weinan Zhang

For a long time, humanity has pursued artificial intelligence (AI) equivalent to or surpassing the human level, with AI agents considered a promising vehicle for this pursuit. AI agents are artificial entities that sense their environment,…

Large Language Models(LLMs) have dramatically revolutionized the field of Natural Language Processing(NLP), offering remarkable capabilities that have garnered widespread usage. However, existing interaction paradigms between LLMs and users…

Computation and Language · Computer Science 2024-03-11 Juhao Liang , Ziwei Wang , Zhuoheng Ma , Jianquan Li , Zhiyi Zhang , Xiangbo Wu , Benyou Wang

Language model (LM) agents have gained significant attention for their ability to autonomously complete tasks through interactions with environments, tools, and APIs. LM agents are primarily built with prompt engineering or supervised…

Artificial Intelligence · Computer Science 2025-07-22 Renxi Wang , Rifo Ahmad Genadi , Bilal El Bouardi , Yongxin Wang , Fajri Koto , Zhengzhong Liu , Timothy Baldwin , Haonan Li

Large Language Models (LLMs) have demonstrated remarkable planning abilities across various domains, including robotics manipulation and navigation. While recent efforts in robotics have leveraged LLMs both for high-level and low-level…

Robotics · Computer Science 2025-08-26 Harsh Singh , Rocktim Jyoti Das , Mingfei Han , Preslav Nakov , Ivan Laptev

The era of Large Language Models (LLMs) presents a new opportunity for interpretability--agentic interpretability: a multi-turn conversation with an LLM wherein the LLM proactively assists human understanding by developing and leveraging a…

Artificial Intelligence · Computer Science 2025-06-17 Been Kim , John Hewitt , Neel Nanda , Noah Fiedel , Oyvind Tafjord

Agentic reinforcement learning increasingly relies on experience-driven scaling, yet real-world environments remain non-adaptive, limited in coverage, and difficult to scale. World models offer a potential way to improve learning efficiency…

Computation and Language · Computer Science 2026-03-06 Yixia Li , Hongru Wang , Jiahao Qiu , Zhenfei Yin , Dongdong Zhang , Cheng Qian , Zeping Li , Pony Ma , Guanhua Chen , Heng Ji

In dynamic open-world environments, autonomous agents often encounter novelties that hinder their ability to find plans to achieve their goals. Specifically, traditional symbolic planners fail to generate plans when the robot's planning…

Robotics · Computer Science 2026-03-13 Hong Lu , Pierrick Lorang , Timothy R. Duggan , Jivko Sinapov , Matthias Scheutz