English
Related papers

Related papers: PixelBrax: Learning Continuous Control from Pixels…

200 papers

Real-time trajectory optimization for nonlinear constrained autonomous systems is critical and typically performed by CPU-based sequential solvers. Specifically, reliance on global sparse linear algebra or the serial nature of dynamic…

Robotics · Computer Science 2026-03-13 Yilin Zou , Zhong Zhang , Maxime Robic , Fanghua Jiang

Deep reinforcement learning (RL) is a powerful framework to train decision-making models in complex environments. However, RL can be slow as it requires repeated interaction with a simulation of the environment. In particular, there are key…

Machine Learning · Computer Science 2021-10-12 Tian Lan , Sunil Srinivasa , Huan Wang , Stephan Zheng

Quadruped robots have emerged as an evolving technology that currently leverages simulators to develop a robust controller capable of functioning in the real-world without the need for further training. However, since it is impossible to…

Robotics · Computer Science 2023-11-14 Giovanni Minelli , Vassilis Vassiliades

The Abstraction and Reasoning Corpus (ARC) tests AI systems' ability to perform human-like inductive reasoning from a few demonstration pairs. Existing Gymnasium-based RL environments severely limit experimental scale due to computational…

Artificial Intelligence · Computer Science 2026-01-27 Aadam , Monu Verma , Mohamed Abdel-Mottaleb

Multi-task Reinforcement Learning (MTRL) has emerged as a critical training paradigm for applying reinforcement learning (RL) to a set of complex real-world robotic tasks, which demands a generalizable and robust policy. At the same time,…

Robotics · Computer Science 2025-08-04 Viraj Joshi , Zifan Xu , Bo Liu , Peter Stone , Amy Zhang

OpenReservoirComputing (ORC) is a Python library for reservoir computing (RC) written in JAX (Bradbury et al. 2018) and Equinox (Kidger and Garcia 2021). JAX is a Python library for high-performance numerical computing that enables…

Machine Learning · Computer Science 2026-03-17 Jan Williams , Dima Tretiak , Steven L. Brunton , J. Nathan Kutz , Krithika Manohar

Traffic congestion is a persistent problem in our society. Previous methods for traffic control have proven futile in alleviating current congestion levels leading researchers to explore ideas with robot vehicles given the increased…

Multiagent Systems · Computer Science 2024-02-06 Michael Villarreal , Bibek Poudel , Jia Pan , Weizi Li

The rapid rise of scientific machine learning (SciML) has expanded the role of differentiable modeling, surrogate modeling, and data-driven constitutive laws in large-scale simulation. The JAX framework provides an attractive environment…

Mathematical Software · Computer Science 2026-04-27 Alberto Cattaneo , M Keith Ballard , Robert M. Kirby , Varun Shankar

Financial exchanges across the world use limit order books (LOBs) to process orders and match trades. For research purposes it is important to have large scale efficient simulators of LOB dynamics. LOB simulators have previously been…

Trading and Market Microstructure · Quantitative Finance 2023-08-28 Sascha Frey , Kang Li , Peer Nagy , Silvia Sapora , Chris Lu , Stefan Zohren , Jakob Foerster , Anisoara Calinescu

While large models trained with self-supervised learning on offline datasets have shown remarkable capabilities in text and image domains, achieving the same generalisation for agents that act in sequential decision problems remains an open…

Machine Learning · Computer Science 2025-03-04 Michael Matthews , Michael Beukman , Chris Lu , Jakob Foerster

Benchmarks play a crucial role in the development and analysis of reinforcement learning (RL) algorithms, with environment availability strongly impacting research. One particularly underexplored intersection is continual learning (CL) in…

Artificial Intelligence · Computer Science 2025-09-09 Tristan Tomilin , Luka van den Boogaard , Samuel Garcin , Bram Grooten , Meng Fang , Yali Du , Mykola Pechenizkiy

Training robots to perform complex control tasks from high-dimensional pixel input using reinforcement learning (RL) is sample-inefficient, because image observations are comprised primarily of task-irrelevant information. By contrast,…

Robotics · Computer Science 2024-10-22 Anthony Liang , Jesse Thomason , Erdem Bıyık

We propose the use of automatic differentiation through the programming framework jax for accelerating a variety of analysis tasks throughout gravitational wave (GW) science. Firstly, we demonstrate that complete waveforms which cover the…

Instrumentation and Methods for Astrophysics · Physics 2023-02-13 Thomas D. P. Edwards , Kaze W. K. Wong , Kelvin K. H. Lam , Adam Coogan , Daniel Foreman-Mackey , Maximiliano Isi , Aaron Zimmerman

In recent years, \emph{Reinforcement Learning} (RL) has made remarkable progress, achieving superhuman performance in a wide range of simulated environments. As research moves toward deploying RL in real-world applications, the field faces…

Most Deep Reinforcement Learning (Deep RL) algorithms require a prohibitively large number of training samples for learning complex tasks. Many recent works on speeding up Deep RL have focused on distributed training and simulation. While…

Robotics · Computer Science 2018-10-25 Jacky Liang , Viktor Makoviychuk , Ankur Handa , Nuttapong Chentanez , Miles Macklin , Dieter Fox

We present a novel, JAX-powered implementation of a parametric component-separation method for CMB polarization data, explicitly designed to handle spatially varying foreground Spectral Energy Distributions (SEDs). The approach models this…

Reinforcement Learning (RL) allows learning non-trivial robot control laws purely from data. However, many successful applications of RL have relied on ad-hoc regularizations, such as hand-crafted curricula, to regularize the learning…

Machine Learning · Computer Science 2023-09-26 Pascal Klink , Florian Wolf , Kai Ploeger , Jan Peters , Joni Pajarinen

In reinforcement learning (RL), sparse rewards can present a significant challenge. Fortunately, expert actions can be utilized to overcome this issue. However, acquiring explicit expert actions can be costly, and expert observations are…

Robotics · Computer Science 2023-07-25 Minh-Huy Hoang , Long Dinh , Hai Nguyen

We present RUBIX, a fully tested, well-documented, and modular Open Source tool developed in JAX, designed to forward model IFU cubes of galaxies from cosmological hydrodynamical simulations. The code automatically parallelizes computations…

Instrumentation and Methods for Astrophysics · Physics 2024-12-12 Ufuk Çakır , Anna Lena Schaible , Tobias Buck

In computer graphics (CG) education, the challenge of finding modern, versatile tools is significant, particularly when integrating both legacy and advanced technologies. Traditional frameworks, often reliant on solid, yet outdated APIs…

Graphics · Computer Science 2024-09-26 John Petropoulos , Manos Kamarianakis , Antonis Protopsaltis , George Papagiannakis