English
Related papers

Related papers: ShuttleEnv: An Interactive Data-Driven RL Environm…

200 papers

Understanding environmental changes from remote sensing imagery is vital for climate resilience, urban planning, and ecosystem monitoring. Yet, current vision language models (VLMs) overlook causal signals from environmental sensors, rely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Hosam Elgendy , Ahmed Sharshar , Ahmed Aboeitta , Mohsen Guizani

Understanding tactical dynamics in badminton requires analyzing entire matches rather than isolated clips. However, existing badminton datasets mainly focus on short clips or task-specific annotations and rarely provide full-match data with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Ning Ding , Keisuke Fujii , Toru Tamaki

Reinforcement learning (RL) has emerged as a powerful paradigm for achieving online agile navigation with quadrotors. Despite this success, policies trained via standard RL typically fail to generalize across significant dynamic variations,…

Robotics · Computer Science 2026-03-12 Jin Zhou , Dongcheng Cao , Xian Wang , Shuo Li

In this paper, we present our proposed approach for active tracking to increase the autonomy of Unmanned Aerial Vehicles (UAVs) using event cameras, low-energy imaging sensors that offer significant advantages in speed and dynamic range.…

Robotics · Computer Science 2024-10-22 Ala Souissi , Hajer Fradi , Panagiotis Papadakis

Learning to play table tennis is a challenging task for robots, as a wide variety of strokes required. Recent advances have shown that deep Reinforcement Learning (RL) is able to successfully learn the optimal actions in a simulated…

Robotics · Computer Science 2022-10-11 Yapeng Gao , Jonas Tebbe , Andreas Zell

We present a system that converts annotated broadcast video of tennis matches into interactively controllable video sprites that behave and appear like professional tennis players. Our approach is based on controllable video textures, and…

Graphics · Computer Science 2020-12-22 Haotian Zhang , Cristobal Sciutto , Maneesh Agrawala , Kayvon Fatahalian

Recent advances in immersive technology have opened new possibilities in sports training, especially for activities requiring precise motor skills, such as tennis. In this paper, we present a virtual reality (VR) tennis training system…

Human-Computer Interaction · Computer Science 2025-04-23 Ryan Najami , Rami Ghannam

We present a data-driven basketball set play simulation. Given an offensive set play sketch, our method simulates potential scenarios that may occur in the game. The simulation provides coaches and players with insights on how a given set…

Multimedia · Computer Science 2019-10-09 Hsin-Ying Hsieh , Chieh-Yu Chen , Yu-Shuen Wang , Jung-Hong Chuang

Using a game engine, we have developed a virtual environment which models important aspects of critical incident scenarios. We focused on modelling phenomena relating to the identification and gathering of key forensic evidence, in order to…

Artificial Intelligence · Computer Science 2018-12-18 David L. Smyth , Frank G. Glavin , Michael G. Madden

Modeling each hit as a multivariate event in racket sports and conducting sequential analysis aids in assessing player/team performance and identifying successful tactics for coaches and analysts. However, the complex correlations among…

Databases · Computer Science 2023-07-27 Jiang Wu , Dongyu Liu , Ziyang Guo , Yingcai Wu

Perception and decision-making in high-speed dynamic scenarios remain challenging for current robots. In contrast, humans and animals can rapidly perceive and make decisions in such environments. Taking table tennis as a typical example,…

Robotics · Computer Science 2026-04-07 Ziqi Wang , Jingyue Zhao , Xun Xiao , Jichao Yang , Yaohua Wang , Shi Xu , Lei Wang , Huadong Dai

Sim-to-real transfer is a powerful paradigm for robotic reinforcement learning. The ability to train policies in simulation enables safe exploration and large-scale data collection quickly at low cost. However, prior works in sim-to-real…

Reinforcement learning (RL) for web agents demands environments that are both effective for evaluation and efficient enough for large-scale on-policy training. Current web environments fall short: server-side Docker setups are too…

Machine Learning · Computer Science 2026-05-19 Yuxuan Lu , Ziyi Wang , Jing Huang , Hui Liu , Jiri Gesi , Yan Han , Shihan Fu , Tianqi Zheng , Xianfeng Tang , Chen Luo , Yisi Sang , Jin Lai , Dakuo Wang

Training robots with physical bodies requires developing new methods and action representations that allow the learning agents to explore the space of policies efficiently. This work studies sample-efficient learning of complex policies in…

Robotics · Computer Science 2019-02-19 Reza Mahjourian , Risto Miikkulainen , Nevena Lazic , Sergey Levine , Navdeep Jaitly

In typical reinforcement learning (RL), the environment is assumed given and the goal of the learning is to identify an optimal policy for the agent taking actions through its interactions with the environment. In this paper, we extend this…

Artificial Intelligence · Computer Science 2019-10-25 Haifeng Zhang , Jun Wang , Zhiming Zhou , Weinan Zhang , Ying Wen , Yong Yu , Wenxin Li

We propose a new benchmark environment for evaluating Reinforcement Learning (RL) algorithms: the PlayStation Learning Environment (PSXLE), a PlayStation emulator modified to expose a simple control API that enables rich game-state…

Machine Learning · Computer Science 2019-12-13 Carlos Purves , Cătălina Cangea , Petar Veličković

This research is intended to accomplish two goals: The first goal is to curate a large and information rich dataset that contains crucial and succinct summaries on the players' actions and positions and the back-and-forth travel patterns of…

Machine Learning · Computer Science 2024-05-17 Haotian Xia , Rhys Tracy , Yun Zhao , Erwan Fraisse , Yuan-Fang Wang , Linda Petzold

Sports tracking data are the high-resolution spatiotemporal observations of a competitive event. The growing collection of these data in professional sport allows us to address a fundamental problem of modern sport: how to attribute value…

Applications · Statistics 2020-05-27 Stephanie Kovalchik , Martin Ingram , Kokum Weeratunga , Cagatay Goncu

We propose RLAnything, a reinforcement learning framework that dynamically forges environment, policy, and reward models through closed-loop optimization, amplifying learning signals and strengthening the overall RL system for any LLM or…

Machine Learning · Computer Science 2026-02-04 Yinjie Wang , Tianbao Xie , Ke Shen , Mengdi Wang , Ling Yang

Interacting with human agents in complex scenarios presents a significant challenge for robotic navigation, particularly in environments that necessitate both collision avoidance and collaborative interaction, such as indoor spaces. Unlike…

Robotics · Computer Science 2024-11-07 Lingfeng Sun , Yixiao Wang , Pin-Yun Hung , Changhao Wang , Xiang Zhang , Zhuo Xu , Masayoshi Tomizuka