English
Related papers

Related papers: Simulating Environments with Reasoning Models for …

200 papers

As large language model agents advance beyond software engineering (SWE) tasks toward machine learning engineering (MLE), verifying agent behavior becomes orders of magnitude more expensive: while SWE tasks can be verified via…

Computation and Language · Computer Science 2026-04-07 Yuhang Zhou , Lizhu Zhang , Yifan Wu , Jiayi Liu , Xiangjun Fan , Zhuokai Zhao , Hong Yan

Recent advances in large language models (LLMs) have enabled software engineering agents to tackle complex code modification tasks. Most existing approaches rely on execution feedback from containerized environments, which require…

The capability of a reinforcement learning (RL) agent heavily depends on the diversity of the learning scenarios generated by the environment. Generation of diverse realistic scenarios is challenging for real-time strategy (RTS)…

Machine Learning · Computer Science 2023-03-30 Abdus Salam Azad , Edward Kim , Qiancheng Wu , Kimin Lee , Ion Stoica , Pieter Abbeel , Sanjit A. Seshia

This study focuses on using large language models (LLMs) as a planner for embodied agents that can follow natural language instructions to complete complex tasks in a visually-perceived environment. The high data cost and poor sample…

Artificial Intelligence · Computer Science 2023-09-08 Chan Hee Song , Jiaman Wu , Clayton Washington , Brian M. Sadler , Wei-Lun Chao , Yu Su

Large Language Models (LLMs) have achieved remarkable success in software engineering tasks when trained with executable runtime environments, particularly in resolving GitHub issues. However, such runtime environments are often unavailable…

Cryptography and Security · Computer Science 2025-08-27 Terry Yue Zhuo , Dingmin Wang , Hantian Ding , Varun Kumar , Zijian Wang

Long context reasoning in large language models (LLMs) has demonstrated enhancement of their cognitive capabilities via chain-of-thought (CoT) inference. Training such models is usually done via reinforcement learning with verifiable…

Computation and Language · Computer Science 2025-12-05 Purbesh Mitra , Sennur Ulukus

There has been a growing interest in developing learner models to enhance learning and teaching experiences in educational environments. However, existing works have primarily focused on structured environments relying on meticulously…

Machine Learning · Computer Science 2024-05-01 Bahar Radmehr , Adish Singla , Tanja Käser

Large language models (LLMs) have demonstrated outstanding performance across various tasks, yet they still exhibit limitations such as hallucination, unfaithful reasoning, and toxic content. One potential approach to mitigate these issues…

Computation and Language · Computer Science 2024-07-19 Yuxuan Yao , Han Wu , Zhijiang Guo , Biyan Zhou , Jiahui Gao , Sichun Luo , Hanxu Hou , Xiaojin Fu , Linqi Song

Building embodied AI systems that can follow arbitrary language instructions in any 3D environment is a key challenge for creating general AI. Accomplishing this goal requires learning to ground language in perception and embodied actions,…

Robotics · Computer Science 2024-10-14 SIMA Team , Maria Abi Raad , Arun Ahuja , Catarina Barros , Frederic Besse , Andrew Bolt , Adrian Bolton , Bethanie Brownfield , Gavin Buttimore , Max Cant , Sarah Chakera , Stephanie C. Y. Chan , Jeff Clune , Adrian Collister , Vikki Copeman , Alex Cullum , Ishita Dasgupta , Dario de Cesare , Julia Di Trapani , Yani Donchev , Emma Dunleavy , Martin Engelcke , Ryan Faulkner , Frankie Garcia , Charles Gbadamosi , Zhitao Gong , Lucy Gonzales , Kshitij Gupta , Karol Gregor , Arne Olav Hallingstad , Tim Harley , Sam Haves , Felix Hill , Ed Hirst , Drew A. Hudson , Jony Hudson , Steph Hughes-Fitt , Danilo J. Rezende , Mimi Jasarevic , Laura Kampis , Rosemary Ke , Thomas Keck , Junkyung Kim , Oscar Knagg , Kavya Kopparapu , Rory Lawton , Andrew Lampinen , Shane Legg , Alexander Lerchner , Marjorie Limont , Yulan Liu , Maria Loks-Thompson , Joseph Marino , Kathryn Martin Cussons , Loic Matthey , Siobhan Mcloughlin , Piermaria Mendolicchio , Hamza Merzic , Anna Mitenkova , Alexandre Moufarek , Valeria Oliveira , Yanko Oliveira , Hannah Openshaw , Renke Pan , Aneesh Pappu , Alex Platonov , Ollie Purkiss , David Reichert , John Reid , Pierre Harvey Richemond , Tyson Roberts , Giles Ruscoe , Jaume Sanchez Elias , Tasha Sandars , Daniel P. Sawyer , Tim Scholtes , Guy Simmons , Daniel Slater , Hubert Soyer , Heiko Strathmann , Peter Stys , Allison C. Tam , Denis Teplyashin , Tayfun Terzi , Davide Vercelli , Bojan Vujatovic , Marcus Wainwright , Jane X. Wang , Zhengdong Wang , Daan Wierstra , Duncan Williams , Nathaniel Wong , Sarah York , Nick Young

Fine-tuning Large Language Models (LLMs) typically relies on large quantities of high-quality annotated data, or questions with well-defined ground truth answers in the case of Reinforcement Learning with Verifiable Rewards (RLVR). While…

Artificial Intelligence · Computer Science 2026-04-21 Justin Bauer , Thomas Walshe , Derek Pham , Harit Vishwakarma , Armin Parchami , Frederic Sala , Paroma Varma

We introduce Agent2 RL-Bench, a compact diagnostic benchmark for evaluating agentic RL post-training, which tests whether LLM agents can autonomously design, implement, debug, and execute post-training pipelines that improve foundation…

Artificial Intelligence · Computer Science 2026-05-14 Wanyi Chen , Xiao Yang , Xu Yang , Tianming Sha , Qizheng Li , Zhuo Wang , Bowen Xian , Fang Kong , Weiqing Liu , Jiang Bian

Reinforcement learning (RL) agents are commonly trained and evaluated in the same environment. In contrast, humans often train in a specialized environment before being evaluated, such as studying a book before taking an exam. The potential…

Machine Learning · Computer Science 2024-06-19 Jarek Liesen , Chris Lu , Andrei Lupu , Jakob N. Foerster , Henning Sprekeler , Robert T. Lange

Recent advancements in large language models (LLMs) have brought significant changes to various domains, especially through LLM-driven autonomous agents. A representative scenario is in software development, where LLM agents demonstrate…

Computation and Language · Computer Science 2024-06-06 Chen Qian , Yufan Dang , Jiahao Li , Wei Liu , Zihao Xie , Yifei Wang , Weize Chen , Cheng Yang , Xin Cong , Xiaoyin Che , Zhiyuan Liu , Maosong Sun

Conducting reinforcement learning (RL) in simulated environments offers a cost-effective and highly scalable way to enhance language-based agents. However, previous work has been limited to semi-automated environment synthesis or tasks…

Computation and Language · Computer Science 2025-12-30 Shihao Cai , Runnan Fang , Jialong Wu , Baixuan Li , Xinyu Wang , Yong Jiang , Liangcai Su , Liwen Zhang , Wenbiao Yin , Zhen Zhang , Fuli Feng , Pengjun Xie , Xiaobin Wang

LLM-based agents can autonomously accomplish complex tasks across various domains. However, to further cultivate capabilities such as adaptive behavior and long-term decision-making, training on static datasets built from human-level…

Machine Learning · Computer Science 2025-12-24 Yuchen Huang , Sijia Li , Minghao Liu , Wei Liu , Shijue Huang , Zhiyuan Fan , Hou Pong Chan , Yi R. Fung

Post-training is essential for enabling large language models (LLMs) to follow human instructions. However, its effectiveness depends on high-quality instruction data, which is challenging to obtain in the real world due to privacy…

Artificial Intelligence · Computer Science 2025-02-21 Shuo Tang , Xianghe Pang , Zexi Liu , Bohan Tang , Rui Ye , Tian Jin , Xiaowen Dong , Yanfeng Wang , Siheng Chen

This paper advances motion agents empowered by large language models (LLMs) toward autonomous navigation in dynamic and cluttered environments, significantly surpassing first and recent seminal but limited studies on LLM's spatial…

Artificial Intelligence · Computer Science 2025-06-06 Yubo Zhao , Qi Wu , Yifan Wang , Yu-Wing Tai , Chi-Keung Tang

Recent advances in the intrinsic reasoning capabilities of large language models (LLMs) have given rise to LLM-based agent systems that exhibit near-human performance on a variety of automated tasks. However, although these systems share…

Artificial Intelligence · Computer Science 2025-08-26 Bingxi Zhao , Lin Geng Foo , Ping Hu , Christian Theobalt , Hossein Rahmani , Jun Liu

Agentic intelligence in large language models (LLMs) requires not only model intrinsic capabilities but also interactions with external environments. Equipping LLMs with computers now represents a prevailing trend. However, the computer…

Computation and Language · Computer Science 2026-04-09 Daixuan Cheng , Shaohan Huang , Yuxian Gu , Huatong Song , Guoxin Chen , Li Dong , Wayne Xin Zhao , Ji-Rong Wen , Furu Wei

We present a synthetic data approach for instruction-tuning large language models (LLMs) for low-resource languages in a data-efficient manner, specifically focusing on Thai. We identify three key properties that contribute to the…

Computation and Language · Computer Science 2024-11-26 Parinthapat Pengpun , Can Udomcharoenchaikit , Weerayut Buaphet , Peerat Limkonchotiwat
‹ Prev 1 3 4 5 6 7 10 Next ›