English
Related papers

Related papers: Controlgym: Large-Scale Control Environments for B…

200 papers

Recent reinforcement learning approaches have shown surprisingly strong capabilities of bang-bang policies for solving continuous control benchmarks. The underlying coarse action space discretizations often yield favourable exploration…

Machine Learning · Computer Science 2024-04-08 Tim Seyde , Peter Werner , Wilko Schwarting , Markus Wulfmeier , Daniela Rus

Within the mathematical finance literature there is a rich catalogue of mathematical models for studying algorithmic trading problems -- such as market-making and optimal execution -- in limit order books. This paper introduces \mbtgym, a…

Trading and Market Microstructure · Quantitative Finance 2022-09-20 Joseph Jerome , Leandro Sanchez-Betancourt , Rahul Savani , Martin Herdegen

Long-horizon planning is widely recognized as a core capability of autonomous LLM-based agents; however, current evaluation frameworks suffer from being largely episodic, domain-specific, or insufficiently grounded in persistent economic…

Machine learning is a prevalent approach to tame the complexity of design space exploration for domain-specific architectures. Using ML for design space exploration poses challenges. First, it's not straightforward to identify the suitable…

Automated planning algorithms require an action model specifying the preconditions and effects of each action, but obtaining such a model is often hard. Learning action models from observations is feasible, but existing algorithms for…

Artificial Intelligence · Computer Science 2026-04-13 Yarin Benyamin , Argaman Mordoch , Shahaf S. Shperberg , Roni Stern

Modern Vision-Language Models (VLMs) remain poorly characterized in multi-step visual interactions, particularly in how they integrate perception, memory, and action over long horizons. We introduce VisGym, a gymnasium of 17 environments…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Zirui Wang , Junyi Zhang , Jiaxin Ge , Long Lian , Letian Fu , Lisa Dunlap , Ken Goldberg , XuDong Wang , Ion Stoica , David M. Chan , Sewon Min , Joseph E. Gonzalez

To maintain structural integrity and functionality during the designed life cycle of a structure, engineers are expected to accommodate for natural hazards as well as operational load levels. Active control systems are an efficient solution…

Systems and Control · Electrical Eng. & Systems 2021-03-16 Soheila Sadeghi Eshkevari , Soheil Sadeghi Eshkevari , Debarshi Sen , Shamim N. Pakzad

Optimal control of the future is the next frontier for AI. Current approaches to this problem are typically rooted in reinforcement learning (RL). RL is mathematically distinct from supervised learning, which has been the main workhorse for…

Machine Learning · Statistics 2026-05-06 Yuxin Bai , Aranyak Acharyya , Ashwin De Silva , Zeyu Shen , James Hassett , Joshua T. Vogelstein

Combinatorial optimization (CO) is fundamental to several real-world applications, from logistics and scheduling to hardware design and resource allocation. Deep reinforcement learning (RL) has recently shown significant benefits in solving…

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

Robotics · Computer Science 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

Deep reinforcement learning (DRL) has demonstrated remarkable performance in many continuous control tasks. However, a significant obstacle to the real-world application of DRL is the lack of safety guarantees. Although DRL agents can…

Robotics · Computer Science 2025-08-15 Weiye Zhao , Feihan Li , Changliu Liu

We present QueryGym, a lightweight, extensible Python toolkit that supports large language model (LLM)-based query reformulation. This is an important tool development since recent work on llm-based query reformulation has shown notable…

Information Retrieval · Computer Science 2025-11-21 Amin Bigdeli , Radin Hamidi Rad , Mert Incesu , Negar Arabzadeh , Charles L. A. Clarke , Ebrahim Bagheri

We present MobileGym, a browser-hosted, lightweight, fully controllable environment for everyday mobile use, targeting interaction fidelity without replicating proprietary backends. It enables two capabilities previously out of reach for…

Artificial Intelligence · Computer Science 2026-05-28 Dingbang Wu , Rui Hao , Haiyang Wang , Shuzhe Wu , Han Xiao , Zhenghong Li , Bojiang Zhou , Zheng Ju , Zichen Liu , Lue Fan , Zhaoxiang Zhang

This paper proposes a novel approach based on deep reinforcement learning (DRL) for the 2D+1 packing problem with spatial constraints. This problem is an extension of the traditional 2D packing problem, incorporating an additional…

Machine Learning · Computer Science 2025-03-25 Victor Ulisses Pugliese , Oséias F. de A. Ferreira , Fabio A. Faria

We introduce ComputerRL, a framework for autonomous desktop intelligence that enables agents to operate complex digital workspaces skillfully. ComputerRL features the API-GUI paradigm, which unifies programmatic API calls and direct GUI…

Artificial Intelligence · Computer Science 2025-10-22 Hanyu Lai , Xiao Liu , Yanxiao Zhao , Han Xu , Hanchen Zhang , Bohao Jing , Yanyu Ren , Shuntian Yao , Yuxiao Dong , Jie Tang

Designing optimal controllers continues to be challenging as systems are becoming complex and are inherently nonlinear. The principal advantage of reinforcement learning (RL) is its ability to learn from the interaction with the environment…

Machine Learning · Computer Science 2018-10-05 Savinay Nagendra , Nikhil Podila , Rashmi Ugarakhod , Koshy George

Nowadays, realistic simulation environments are essential to validate and build reliable robotic solutions. This is particularly true when using Reinforcement Learning (RL) based control policies. To this end, both robotics and RL…

Robotics · Computer Science 2023-10-12 Matteo El-Hariry , Antoine Richard , Miguel Olivares-Mendez

This paper presents a control framework that combines model-based optimal control and reinforcement learning (RL) to achieve versatile and robust legged locomotion. Our approach enhances the RL training process by incorporating on-demand…

Robotics · Computer Science 2024-10-01 Dongho Kang , Jin Cheng , Miguel Zamora , Fatemeh Zargarbashi , Stelian Coros

Reinforcement learning (RL) algorithms have become indispensable tools in artificial intelligence, empowering agents to acquire optimal decision-making policies through interactions with their environment and feedback mechanisms. This study…

Machine Learning · Computer Science 2024-03-28 Ergon Cugler de Moraes Silva

Recently, researchers have made significant progress combining the advances in deep learning for learning feature representations with reinforcement learning. Some notable examples include training agents to play Atari games based on raw…

Machine Learning · Computer Science 2016-05-30 Yan Duan , Xi Chen , Rein Houthooft , John Schulman , Pieter Abbeel