English
Related papers

Related papers: POPGym: Benchmarking Partially Observable Reinforc…

200 papers

A promising characteristic of Deep Reinforcement Learning (DRL) is its capability to learn optimal policy in an end-to-end manner without relying on feature engineering. However, most approaches assume a fully observable state space, i.e.…

Machine Learning · Computer Science 2021-09-14 Lingheng Meng , Rob Gorbet , Dana Kulić

Reinforcement Learning (RL) is a promising solution, allowing Unmanned Underwater Vehicles (UUVs) to learn optimal behaviors through trial and error. However, existing simulators lack efficient integration with RL methods, limiting training…

Robotics · Computer Science 2024-10-21 Shuguang Chu , Zebin Huang , Mingwei Lin , Dejun Li , Ignacio Carlucho

Deep reinforcement learning (DRL) is one of the most powerful tools for synthesizing complex robotic behaviors. But training DRL models is incredibly compute and memory intensive, requiring large training datasets and replay buffers to…

Robotics · Computer Science 2023-04-25 Lev Grossman , Brian Plancher

Evaluating whether Multimodal Large Language Models (MLLMs) genuinely reason about physical dynamics remains challenging. Most existing benchmarks rely on recognition-style protocols such as Visual Question Answering (VQA) and Violation of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Jiarong Liang , Max Ku , Ka-Hei Hui , Ping Nie , Wenhu Chen

RSL-RL is an open-source Reinforcement Learning library tailored to the specific needs of the robotics community. Unlike broad general-purpose frameworks, its design philosophy prioritizes a compact and easily modifiable codebase, allowing…

Robotics · Computer Science 2025-09-16 Clemens Schwarke , Mayank Mittal , Nikita Rudin , David Hoeller , Marco Hutter

We need intelligent robots for mobile construction, the process of navigating in an environment and modifying its structure according to a geometric design. In this task, a major robot vision and learning challenge is how to exactly achieve…

Robotics · Computer Science 2021-04-01 Wenyu Han , Chen Feng , Haoran Wu , Alexander Gao , Armand Jordana , Dong Liu , Lerrel Pinto , Ludovic Righetti

Recent advancements in large language models (LLMs) underscore the need for more comprehensive evaluation methods to accurately assess their reasoning capabilities. Existing benchmarks are often domain-specific and thus cannot fully capture…

Reinforcement learning (RL) has progressed substantially over the past decade, with much of this progress being driven by benchmarks. Many benchmarks are focused on video or board games, and a large number of robotics benchmarks lack…

Robotics · Computer Science 2024-07-23 Michael Beukman , Branden Ingram , Geraud Nangue Tasse , Benjamin Rosman , Pravesh Ranchod

Protein language models (PLMs) have advanced computational protein science through large-scale pretraining and scalable architectures. In parallel, reinforcement learning (RL) has broadened exploration and enabled precise multi-objective…

In this work we propose Neuro-Nav, an open-source library for neurally plausible reinforcement learning (RL). RL is among the most common modeling frameworks for studying decision making, learning, and navigation in biological organisms. In…

Neural and Evolutionary Computing · Computer Science 2022-06-08 Arthur Juliani , Samuel Barnett , Brandon Davis , Margaret Sereno , Ida Momennejad

Aligning a lens system relative to an imager is a critical challenge in camera manufacturing. While optimal alignment can be mathematically computed under ideal conditions, real-world deviations caused by manufacturing tolerances often…

Robotics · Computer Science 2025-10-06 Matthias Burkhardt , Tobias Schmähling , Pascal Stegmann , Michael Layh , Tobias Windisch

Algorithmic reasoning is a fundamental cognitive ability that plays a pivotal role in problem-solving and decision-making processes. Reinforcement Learning (RL) has demonstrated remarkable proficiency in tasks such as motor control,…

Machine Learning · Computer Science 2024-07-02 Benjamin Estermann , Luca A. Lanzendörfer , Yannick Niedermayr , Roger Wattenhofer

We present MobileGym, a browser-hosted, lightweight, fully controllable environment for everyday mobile use, targeting interaction fidelity without replicating proprietary backends. It enables two capabilities previously out of reach for…

Artificial Intelligence · Computer Science 2026-05-28 Dingbang Wu , Rui Hao , Haiyang Wang , Shuzhe Wu , Han Xiao , Zhenghong Li , Bojiang Zhou , Zheng Ju , Zichen Liu , Lue Fan , Zhaoxiang Zhang

Search agents have emerged as a pivotal paradigm for solving open-ended, knowledge-intensive reasoning tasks. However, training these agents via Reinforcement Learning (RL) faces a critical dilemma: interacting with live commercial Web APIs…

Computation and Language · Computer Science 2026-01-22 Xichen Zhang , Ziyi He , Yinghao Zhu , Sitong Wu , Shaozuo Yu , Meng Chu , Wenhu Zhang , Haoru Tan , Jiaya Jia

Robots moving safely and in a socially compliant manner in dynamic human environments is an essential benchmark for long-term robot autonomy. However, it is not feasible to learn and benchmark social navigation behaviors entirely in the…

Robotics · Computer Science 2022-08-03 Jarrett Holtz , Joydeep Biswas

Reinforcement learning would enjoy better success on real-world problems if domain knowledge could be imparted to the algorithm by the modelers. Most problems have both hidden state and unknown dynamics. Partially observable Markov decision…

Machine Learning · Computer Science 2013-01-07 Christian R. Shelton

Offline reinforcement learning (RL) aims at learning a good policy from a batch of collected data, without extra interactions with the environment during training. However, current offline RL benchmarks commonly have a large reality gap,…

Machine Learning · Computer Science 2021-02-09 Rongjun Qin , Songyi Gao , Xingyuan Zhang , Zhen Xu , Shengkai Huang , Zewen Li , Weinan Zhang , Yang Yu

This paper proposes Partially Observable Reference Policy Programming, a novel anytime online approximate POMDP solver which samples meaningful future histories very deeply while simultaneously forcing a gradual policy update. We provide…

Artificial Intelligence · Computer Science 2025-07-17 Edward Kim , Hanna Kurniawati

Reinforcement Learning with Verifiable Rewards (RLVR) has proven to be a highly effective strategy for endowing Large Language Models (LLMs) with robust multi-step reasoning abilities. However, its design and optimizations remain tailored…

Computation and Language · Computer Science 2026-04-15 Zhenhailong Wang , Xuehang Guo , Sofia Stoica , Haiyang Xu , Hongru Wang , Hyeonjeong Ha , Xiusi Chen , Yangyi Chen , Ming Yan , Fei Huang , Heng Ji

Remote Photoplethysmography (rPPG) is a promising technique to monitor physiological signals such as heart rate from facial videos. However, the labeled facial videos in this research are challenging to collect. Current rPPG research is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Bingjie Wu , Zitong Yu , Yiping Xie , Wei Liu , Chaoqi Luo , Yong Liu , Rick Siow Mong Goh