English
Related papers

Related papers: TorchBeast: A PyTorch Platform for Distributed RL

200 papers

This paper provides a simulated laboratory for making use of Reinforcement Learning (RL) for chemical discovery. Since RL is fairly data intensive, training agents `on-the-fly' by taking actions in the real world is infeasible and possibly…

Recent decades have witnessed remarkable advancements in artificial intelligence (AI), including large language models (LLMs), image and video generative models, and embodied AI systems. These advancements have led to an explosive increase…

Machine Learning · Computer Science 2025-02-12 Zixiao Wang , Jieya Zhou , Su Zheng , Shuo Yin , Kaichao Liang , Shoubo Hu , Xiao Chen , Bei Yu

The efficiency of game engines and policy optimization algorithms is crucial for training reinforcement learning (RL) agents in complex sequential decision-making tasks, such as Tetris. Existing Tetris implementations suffer from low…

Artificial Intelligence · Computer Science 2026-03-31 Xingguo Chen , Pingshou Xiong , Zhenyu Luo , Mengfei Hu , Xinwen Li , Yongzhou Lü , Guang Yang , Chao Li , Shangdong Yang

This paper introduces Unity RL Playground, an open-source reinforcement learning framework built on top of Unity ML-Agents. Unity RL Playground automates the process of training mobile robots to perform various locomotion tasks such as…

Robotics · Computer Science 2025-03-10 Linqi Ye , Rankun Li , Xiaowen Hu , Jiayi Li , Boyang Xing , Yan Peng , Bin Liang

FasterAI is a PyTorch-based library, aiming to facilitate the utilization of deep neural networks compression techniques such as sparsification, pruning, knowledge distillation, or regularization. The library is built with the purpose of…

Machine Learning · Computer Science 2022-07-05 Nathan Hubens

We present PrismSSL, a Python library that unifies state-of-the-art self-supervised learning (SSL) methods across audio, vision, graphs, and cross-modal settings in a single, modular codebase. The goal of the demo is to show how researchers…

Machine Learning · Computer Science 2025-11-25 Melika Shirian , Kianoosh Vadaei , Kian Majlessi , Audrina Ebrahimi , Arshia Hemmat , Peyman Adibi , Hossein Karshenas

This paper presents cltorch, a hardware-agnostic backend for the Torch neural network framework. cltorch enables training of deep neural networks on GPUs from diverse hardware vendors, including AMD, NVIDIA, and Intel. cltorch contains…

Neural and Evolutionary Computing · Computer Science 2016-06-16 Hugh Perkins

Vision-language-action (VLA) models can learn to perform diverse manipulation skills "out of the box," but achieving the precision and speed that real-world tasks demand requires further fine-tuning -- for example, via reinforcement…

Machine Learning · Computer Science 2026-05-04 Charles Xu , Jost Tobias Springenberg , Michael Equi , Ali Amin , Adnan Esmail , Sergey Levine , Liyiming Ke

This work re-implements the OpenAI Gym multi-goal robotic manipulation environment, originally based on the commercial Mujoco engine, onto the open-source Pybullet engine. By comparing the performances of the Hindsight Experience…

Robotics · Computer Science 2023-03-10 Xintong Yang , Ze Ji , Jing Wu , Yu-Kun Lai

We present PantheonRL, a multiagent reinforcement learning software package for dynamic training interactions such as round-robin, adaptive, and ad-hoc training. Our package is designed around flexible agent objects that can be easily…

Multiagent Systems · Computer Science 2023-10-25 Bidipta Sarkar , Aditi Talati , Andy Shih , Dorsa Sadigh

RSL-RL is an open-source Reinforcement Learning library tailored to the specific needs of the robotics community. Unlike broad general-purpose frameworks, its design philosophy prioritizes a compact and easily modifiable codebase, allowing…

Robotics · Computer Science 2025-09-16 Clemens Schwarke , Mayank Mittal , Nikita Rudin , David Hoeller , Marco Hutter

With the increased availability of rich tactile sensors, there is an equally proportional need for open-source and integrated software capable of efficiently and effectively processing raw touch measurements into high-level signals that can…

Robotics · Computer Science 2021-05-28 Mike Lambeta , Huazhe Xu , Jingwei Xu , Po-Wei Chou , Shaoxiong Wang , Trevor Darrell , Roberto Calandra

We introduce rLLM (relationLLM), a PyTorch library designed for Relational Table Learning (RTL) with Large Language Models (LLMs). The core idea is to decompose state-of-the-art Graph Neural Networks, LLMs, and Table Neural Networks into…

Artificial Intelligence · Computer Science 2025-11-13 Weichen Li , Xiaotong Huang , Jianwu Zheng , Zheng Wang , Chaokun Wang , Li Pan , Jianhua Li

We present an open-source tensor network Python library for quantum many-body simulations. At its core is an abelian-symmetric tensor, implemented as a sparse block structure managed by logical layer on top of dense multi-dimensional array…

Strongly Correlated Electrons · Physics 2025-03-05 Marek M. Rams , Gabriela Wójtowicz , Aritra Sinha , Juraj Hasik

StarCraft, one of the most difficult esport games with long-standing history of professional tournaments, has attracted generations of players and fans, and also, intense attentions in artificial intelligence research. Recently, Google's…

Artificial Intelligence · Computer Science 2021-05-03 Lei Han , Jiechao Xiong , Peng Sun , Xinghai Sun , Meng Fang , Qingwei Guo , Qiaobo Chen , Tengfei Shi , Hongsheng Yu , Xipeng Wu , Zhengyou Zhang

Neural Networks are notoriously difficult to inspect. We introduce comgra, an open source python library for use with PyTorch. Comgra extracts data about the internal activations of a model and organizes it in a GUI (graphical user…

Machine Learning · Computer Science 2024-08-01 Florian Dietz , Sophie Fellenz , Dietrich Klakow , Marius Kloft

Background: Simulated nucleotide or amino acid sequences are frequently used to assess the performance of phylogenetic reconstruction methods. BEAST, a Bayesian statistical framework that focuses on reconstructing time-calibrated molecular…

Populations and Evolution · Quantitative Biology 2013-12-18 Filip Bielejec , Philippe Lemey , Luiz Max Carvalho , Guy Baele , Andrew Rambaut , Marc A. Suchard

py-irt is a Python library for fitting Bayesian Item Response Theory (IRT) models. py-irt estimates latent traits of subjects and items, making it appropriate for use in IRT tasks as well as ideal-point models. py-irt is built on top of the…

Computation and Language · Computer Science 2022-11-16 John P. Lalor , Pedro Rodriguez

We introduce Sorrel (https://github.com/social-ai-uoft/sorrel), a simple Python interface for generating and testing new multi-agent reinforcement learning environments. This interface places a high degree of emphasis on simplicity and…

Multiagent Systems · Computer Science 2025-06-03 Rebekah A. Gelpí , Yibing Ju , Ethan C. Jackson , Yikai Tang , Shon Verch , Claas Voelcker , William A. Cunningham

In this work we detail a novel open source library, called MMLSpark, that combines the flexible deep learning library Cognitive Toolkit, with the distributed computing framework Apache Spark. To achieve this, we have contributed Java…