English
Related papers

Related papers: Simulating Environments with Reasoning Models for …

200 papers

Despite advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), their integration into language-grounded, human-like embodied agents remains incomplete, hindering complex real-life task performance in physical…

Computation and Language · Computer Science 2024-08-20 Zhili Cheng , Zhitong Wang , Jinyi Hu , Shengding Hu , An Liu , Yuge Tu , Pengkai Li , Lei Shi , Zhiyuan Liu , Maosong Sun

Thorough simulation testing is crucial for validating the correct behavior of small Uncrewed Aerial Systems (sUAS) across multiple scenarios, including adverse weather conditions (such as wind, and fog), diverse settings (hilly terrain, or…

Software Engineering · Computer Science 2025-01-22 Venkata Sai Aswath Duvvuru , Bohan Zhang , Michael Vierhauser , Ankit Agrawal

While current software agents powered by large language models (LLMs) and agentic reinforcement learning (RL) can boost programmer productivity, their training data (e.g., GitHub issues and pull requests) and environments (e.g.,…

Software Engineering · Computer Science 2026-05-20 Yuxiang Wei , Zhiqing Sun , Emily McMilin , Jonas Gehring , David Zhang , Gabriel Synnaeve , Daniel Fried , Lingming Zhang , Sida Wang

Simulating how team members collaborate within complex environments using Agentic AI is a promising approach to explore hypotheses grounded in social science theories and study team behaviors. We introduce VirtLab, a user-friendly,…

The remarkable performance of Large Language Models (LLMs) can be enhanced with test-time computation, which relies on external tools and even other deep learning models. However, existing approaches for integrating non-text modality…

Computation and Language · Computer Science 2025-12-12 Tianle Zhang , Wanlong Fang , Jonathan Woo , Paridhi Latawa , Deepak A. Subramanian , Alvin Chan

We design a simple reinforcement learning (RL) agent that implements an optimistic version of $Q$-learning and establish through regret analysis that this agent can operate with some level of competence in any environment. While we leverage…

Machine Learning · Computer Science 2021-07-13 Shi Dong , Benjamin Van Roy , Zhengyuan Zhou

We present Agent Lightning, a flexible and extensible framework that enables Reinforcement Learning (RL)-based training of Large Language Models (LLMs) for any AI agent. Unlike existing methods that tightly couple RL training with agent or…

Artificial Intelligence · Computer Science 2025-08-06 Xufang Luo , Yuge Zhang , Zhiyuan He , Zilong Wang , Siyun Zhao , Dongsheng Li , Luna K. Qiu , Yuqing Yang

Large Language Models (LLMs) as agents often struggle in out-of-distribution (OOD) scenarios. Real-world environments are complex and dynamic, governed by task-specific rules and stochasticity, which makes it difficult for LLMs to ground…

Machine Learning · Computer Science 2025-10-20 Shiqi Chen , Tongyao Zhu , Zian Wang , Jinghan Zhang , Kangrui Wang , Siyang Gao , Teng Xiao , Yee Whye Teh , Junxian He , Manling Li

Reinforcement Learning (RL) agents often struggle in sparse-reward environments where traditional exploration strategies fail to discover effective action sequences. Large Language Models (LLMs) possess procedural knowledge and reasoning…

Machine Learning · Computer Science 2025-10-13 Vaibhav Jain , Gerrit Grossmann

Recent advancements on Large Language Models (LLMs) enable AI Agents to automatically generate and execute multi-step plans to solve complex tasks. However, since LLM's content generation process is hardly controllable, current LLM-based…

Machine Learning · Computer Science 2024-08-13 Zelong Li , Wenyue Hua , Hao Wang , He Zhu , Yongfeng Zhang

Large Language Models (LLMs) are increasingly being explored for building Agents capable of active environmental interaction (e.g., via tool use) to solve complex problems. Reinforcement Learning (RL) is considered a key technology with…

Computation and Language · Computer Science 2025-11-19 Mingyue Cheng , Jie Ouyang , Shuo Yu , Ruiran Yan , Yucong Luo , Zirui Liu , Daoyu Wang , Qi Liu , Enhong Chen

Providing high-quality feedback on student assignments is crucial for student success, but it is heavily limited by time and budgetary constraints. In this work, we introduce Synthetic Educational Feedback Loops (SEFL), a synthetic data…

Computation and Language · Computer Science 2026-02-25 Mike Zhang , Amalie Pernille Dilling , Léon Gondelman , Niels Erik Ruan Lyngdorf , Euan D. Lindsay , Johannes Bjerva

Reinforcement learning (RL) has become a prevalent paradigm for training tool calling agents, which typically requires online interactive environments. Existing approaches either rely on training data with ground truth annotations or…

Machine Learning · Computer Science 2026-05-08 Chenming Tang , Hsiu-Yuan Huang , Weijie Liu , Junqiang Zheng , Saiyong Yang , Yunfang Wu

Assistive agents should not only take actions on behalf of a human, but also step out of the way and cede control when there are important decisions to be made. However, current methods for building assistive agents, whether via mimicking…

Artificial Intelligence · Computer Science 2025-10-17 Evan Ellis , Vivek Myers , Jens Tuyls , Sergey Levine , Anca Dragan , Benjamin Eysenbach

Large language model (LLM) simulations of human behavior have the potential to revolutionize the social and behavioral sciences, if and only if they faithfully reflect real human behaviors. Current evaluations of simulation fidelity are…

Computation and Language · Computer Science 2026-04-14 Tiancheng Hu , Joachim Baumann , Lorenzo Lupo , Nigel Collier , Dirk Hovy , Paul Röttger

Fact-seeking question answering with large language models (LLMs) remains unreliable when answers depend on up-to-date or conflicting information. Although retrieval-augmented and tool-using LLMs reduce hallucinations, they often rely on…

Computation and Language · Computer Science 2026-03-17 Auksarapak Kietkajornrit , Jad Tarifi , Nima Asgharbeygi

Can LLM agents explore codebases and reason about code semantics without executing the code? We study this capability, which we call agentic code reasoning, and introduce semi-formal reasoning: a structured prompting methodology that…

Software Engineering · Computer Science 2026-03-05 Shubham Ugare , Satish Chandra

We adapt Parameterized Environment Response Model (PERM), a method for training both Reinforcement Learning (RL) Agents and human learners in parameterized environments by directly modeling difficulty and ability. Inspired by Item Response…

Artificial Intelligence · Computer Science 2023-12-06 Sidney Tio , Jimmy Ho , Pradeep Varakantham

Reinforcement learning (RL) is one of the most active fields of AI research. Despite the interest demonstrated by the research community in reinforcement learning, the development methodology still lags behind, with a severe lack of…

Machine Learning · Computer Science 2023-06-08 Andreas Schuderer , Stefano Bromuri , Marko van Eekelen

Procedural generation techniques in 3D rendering engines have revolutionized the creation of complex environments, reducing reliance on manual design. Recent approaches using Large Language Models (LLMs) for 3D scene generation show promise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Arafa Yoncalik , Wouter Jansen , Nico Huebel , Mohammad Hasan Rahmani , Jan Steckel