English
Related papers

Related papers: ECHO: Terminal Agents Learn World Models for Free

200 papers

LLM agents increasingly operate in open-ended environments spanning hundreds of sequential episodes, yet they remain largely stateless: each task is solved from scratch without converting past experience into better future behavior. The…

Computation and Language · Computer Science 2026-04-24 Wujiang Xu , Jiaojiao Han , Minghao Guo , Kai Mei , Xi Zhu , Han Zhang , Dimitris N. Metaxas

We introduce TerminalWorld, a scalable data engine that automatically reverse-engineers high-fidelity evaluation tasks from "in-the-wild" terminal recordings. Processing 80,870 terminal recordings, the engine yields a full benchmark of…

Artificial Intelligence · Computer Science 2026-05-22 Zhaoyang Chu , Jiarui Hu , Xingyu Jiang , Pengyu Zou , Han Li , Chao Peng , Peter O'Hearn , Earl T. Barr , Mark Harman , Federica Sarro , He Ye

We introduce Emergent Trust Learning (ETL), a lightweight, trust-based control algorithm that can be plugged into existing AI agents. It enables these to reach cooperation in competitive game environments under shared resources. Each agent…

Multiagent Systems · Computer Science 2026-03-19 Qianpu Chen , Giulio Barbero , Mike Preuss , Derya Soydaner

Language model (LM)-based embodied agents are increasingly deployed in real-world settings. Yet, their adaptability remains limited in dynamic environments, where constructing accurate and flexible world models is crucial for effective…

Artificial Intelligence · Computer Science 2026-02-02 Jinwoo Jang , Minjong Yoo , Sihyung Yoon , Honguk Woo

Learning control policies for complex, long-horizon tasks is a central challenge in robotics and autonomous systems. Signal Temporal Logic (STL) offers a powerful and expressive language for specifying such tasks, but its non-Markovian…

Robotics · Computer Science 2025-10-02 Yue Meng , Fei Chen , Chuchu Fan

Training large language models (LLMs) as interactive agents presents unique challenges including long-horizon decision making and interacting with stochastic environment feedback. While reinforcement learning (RL) has enabled progress in…

Speculative Decoding promises to accelerate the inference of Large Language Models, yet its efficacy often degrades in production-grade serving. Existing evaluations typically overlook the compute-bound nature of high-concurrency regimes,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-15 Xinyi Hu , Yuhao Shen , Baolin Zhang , Hengxin Zhang , Jun Dai , Shuang Ge , Lei Chen , Yue Li , Mingcheng Wan

We release Terminal Wrench, a subset of 331 terminal-agent benchmark environments, copied from the popular open benchmarks that are demonstrably reward-hackable. The data set includes 3,632 hack trajectories and 2,352 legitimate baseline…

Cryptography and Security · Computer Science 2026-04-21 Ivan Bercovich , Ivgeni Segal , Kexun Zhang , Shashwat Saxena , Aditi Raghunathan , Ziqian Zhong

This work explores employing the concept of goal-oriented (GO) semantic communication for real-time monitoring and control. Generally, GO communication advocates for the deep integration of application targets into the network design. We…

Networking and Internet Architecture · Computer Science 2025-02-25 Polina Kutsevol , Onur Ayan , Nikolaos Pappas , Wolfgang Kellerer

End-to-end GUI agents for real desktop environments require large amounts of high-quality interaction data, yet collecting human demonstrations is expensive and existing synthetic pipelines often suffer from limited task diversity or noisy,…

Artificial Intelligence · Computer Science 2026-04-14 Jinbiao Wei , Yilun Zhao , Kangqi Ni , Arman Cohan

We propose RLAnything, a reinforcement learning framework that dynamically forges environment, policy, and reward models through closed-loop optimization, amplifying learning signals and strengthening the overall RL system for any LLM or…

Machine Learning · Computer Science 2026-02-04 Yinjie Wang , Tianbao Xie , Ke Shen , Mengdi Wang , Ling Yang

Test-time training (TTT) adapts model parameters on unlabeled test instances during inference time, which continuously extends capabilities beyond the reach of offline training. Despite initial gains, existing TTT methods for LRMs plateau…

Machine Learning · Computer Science 2026-04-22 Qingyang Zhang , Xinke Kong , Haitao Wu , Qinghua Hu , Minghao Wu , Baosong Yang , Yu Cheng , Yun Luo , Ganqu Cui , Changqing Zhang

Voice Assistants such as Alexa, Siri, and Google Assistant typically use a two-stage Spoken Language Understanding pipeline; first, an Automatic Speech Recognition (ASR) component to process customer speech and generate text transcriptions,…

Computation and Language · Computer Science 2020-12-17 Subendhu Rongali , Beiye Liu , Liwei Cai , Konstantine Arkoudas , Chengwei Su , Wael Hamza

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an important paradigm for unlocking reasoning capabilities in large language models, exemplified by the success of OpenAI o1 and DeepSeek-R1. Currently, Group Relative…

Machine Learning · Computer Science 2026-01-08 Shijie Zhang , Kevin Zhang , Zheyuan Gu , Xiang Guo , Rujun Guo , Shaoyu Liu , Guanjun Jiang , Xiaozhao Wang

Reinforcement learning (RL) has substantially improved the ability of large language model (LLM) agents to interact with environments and solve multi-turn tasks. However, effective agentic RL remains challenging: sparse outcome-only rewards…

This whitepaper reports on Project CLAI (Command Line AI), which aims to bring the power of AI to the command line interface (CLI). The CLAI platform sets up the CLI as a new environment for AI researchers to conquer by surfacing the…

Human-Computer Interaction · Computer Science 2020-06-19 Mayank Agarwal , Jorge J. Barroso , Tathagata Chakraborti , Eli M. Dow , Kshitij Fadnis , Borja Godoy , Madhavan Pallan , Kartik Talamadupula

Environment Sound Classification has been a well-studied research problem in the field of signal processing and up till now more focus has been laid on fully supervised approaches. Over the last few years, focus has moved towards…

We present ECHO, an edge--cloud framework for language-driven whole-body control of humanoid robots. A cloud-hosted diffusion-based text-to-motion generator synthesizes motion references from natural language instructions, while an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Haozhe Jia , Jianfei Song , Yuan Zhang , Honglei Jin , Youcheng Fan , Wenshuo Chen , Wei Zhang , Yutao Yue

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Command line interface (CLI) agents are emerging as a practical paradigm for agent-computer interaction over evolving filesystems, executable command line programs, and online execution feedback. Recent work has used reinforcement learning…

Artificial Intelligence · Computer Science 2026-05-11 Haoyang Su , Ying Wen