English
Related papers

Related papers: TorchBeast: A PyTorch Platform for Distributed RL

200 papers

PyTorch Adapt is a library for domain adaptation, a type of machine learning algorithm that re-purposes existing models to work in new domains. It is a fully-featured toolkit, allowing users to create a complete train/test pipeline in a few…

Machine Learning · Computer Science 2022-11-30 Kevin Musgrave , Serge Belongie , Ser-Nam Lim

There is a need for open-source libraries in emission tomography that (i) use modern and popular backend code to encourage community contributions and (ii) offer support for the multitude of reconstruction techniques available in recent…

Robotics has made remarkable hardware strides-from DARPA's Urban and Robotics Challenges to the first humanoid-robot kickboxing tournament-yet commercial autonomy still lags behind progress in machine learning. A major bottleneck is…

The DIVA model is a computational model of speech motor control that combines a simulation of the brain regions responsible for speech production with a model of the human vocal tract. The model is currently implemented in Matlab Simulink;…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-19 Sean Kinahan , Julie Liss , Visar Berisha

Large Transformers have achieved state-of-the-art performance across many tasks. Most open-source libraries on scaling Transformers focus on improving training or inference with better parallelization. In this work, we present TorchScale,…

Machine Learning · Computer Science 2022-11-24 Shuming Ma , Hongyu Wang , Shaohan Huang , Wenhui Wang , Zewen Chi , Li Dong , Alon Benhaim , Barun Patra , Vishrav Chaudhary , Xia Song , Furu Wei

Reinforcement learning (RL) for web agents demands environments that are both effective for evaluation and efficient enough for large-scale on-policy training. Current web environments fall short: server-side Docker setups are too…

Machine Learning · Computer Science 2026-05-19 Yuxuan Lu , Ziyi Wang , Jing Huang , Hui Liu , Jiri Gesi , Yan Han , Shihan Fu , Tianqi Zheng , Xianfeng Tang , Chen Luo , Yisi Sang , Jin Lai , Dakuo Wang

Finding errors in machine learning applications requires a thorough exploration of their behavior over data. Existing approaches used by practitioners are often ad-hoc and lack the abstractions needed to scale this process. We present…

Databases · Computer Science 2024-10-17 Aaditya Naik , Adam Stein , Yinjun Wu , Mayur Naik , Eric Wong

The field of Multi-Agent Reinforcement Learning (MARL) is currently facing a reproducibility crisis. While solutions for standardized reporting have been proposed to address the issue, we still lack a benchmarking tool that enables…

Machine Learning · Computer Science 2024-11-26 Matteo Bettini , Amanda Prorok , Vincent Moens

We present mjlab, a lightweight, open-source framework for robot learning that combines GPU-accelerated simulation with composable environments and minimal setup friction. mjlab adopts the manager-based API introduced by Isaac Lab, where…

Robotics · Computer Science 2026-02-26 Kevin Zakka , Qiayuan Liao , Brent Yi , Louis Le Lay , Koushil Sreenath , Pieter Abbeel

The burgeoning complexity and real-time processing demands of audio signals necessitate optimized algorithms that harness the computational prowess of Graphics Processing Units (GPUs). Existing Digital Signal Processing (DSP) libraries…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-14 Matteo Spanio , Antonio Rodà

It is a widely accepted principle that software without tests has bugs. Testing reinforcement learning agents is especially difficult because of the stochastic nature of both agents and environments, the complexity of state-of-the-art…

Artificial Intelligence · Computer Science 2019-01-28 John Foley , Emma Tosch , Kaleigh Clary , David Jensen

This paper introduces an innovative approach to boost the efficiency and scalability of Evolutionary Rule-based machine Learning (ERL), a key technique in explainable AI. While traditional ERL systems can distribute processes across…

Neural and Evolutionary Computing · Computer Science 2025-05-27 Hormoz Shahrzad , Risto Miikkulainen

This paper presents solo-learn, a library of self-supervised methods for visual representation learning. Implemented in Python, using Pytorch and Pytorch lightning, the library fits both research and industry needs by featuring distributed…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Victor G. Turrisi da Costa , Enrico Fini , Moin Nabi , Nicu Sebe , Elisa Ricci

Reinforcement learning (RL) is a general and well-known method that a robot can use to learn an optimal control policy to solve a particular task. We would like to build a versatile robot that can learn multiple tasks, but using RL for each…

Artificial Intelligence · Computer Science 2015-12-01 Lisa Lee

With AlphaGo defeats top human players, reinforcement learning(RL) algorithms have gradually become the code-base of building stronger artificial intelligence(AI). The RL algorithm design firstly needs to adapt to the specific environment,…

In this paper, we propose ELF, an Extensive, Lightweight and Flexible platform for fundamental reinforcement learning research. Using ELF, we implement a highly customizable real-time strategy (RTS) engine with three game environments…

Artificial Intelligence · Computer Science 2017-11-13 Yuandong Tian , Qucheng Gong , Wenling Shang , Yuxin Wu , C. Lawrence Zitnick

PyRep is a toolkit for robot learning research, built on top of the virtual robotics experimentation platform (V-REP). Through a series of modifications and additions, we have created a tailored version of V-REP built with robot learning in…

Robotics · Computer Science 2019-06-27 Stephen James , Marc Freese , Andrew J. Davison

Textless spoken language processing research aims to extend the applicability of standard NLP toolset onto spoken language and languages with few or no textual resources. In this paper, we introduce textless-lib, a PyTorch-based library…

Pattern recognition and machine learning are becoming integral parts of algorithms in a wide range of applications. Different algorithms and approaches for machine learning include different tradeoffs between performance and computation, so…

Machine Learning · Statistics 2014-06-24 Kenneth D. Morton , Peter Torrione , Leslie Collins , Sam Keene

The majority of automated machine learning (AutoML) solutions are developed in Python, however a large percentage of data scientists are associated with the R language. Unfortunately, there are limited R solutions available. Moreover high…

Machine Learning · Computer Science 2024-09-10 Hubert Ruczyński , Anna Kozak