English
Related papers

Related papers: TrajGPT-R: Generating Urban Mobility Trajectory wi…

200 papers

GPS trajectories are the essential foundations for many trajectory-based applications, such as travel time estimation, traffic prediction and trajectory similarity measurement. Most applications require a large amount of high sample rate…

Machine Learning · Computer Science 2022-11-29 Yuqi Chen , Hanyuan Zhang , Weiwei Sun , Baihua Zheng

Reinforcement learning (RL) trains an agent from experiences interacting with the environment. In scenarios where online interactions are impractical, offline RL, which trains the agent using pre-collected datasets, has become popular.…

Machine Learning · Computer Science 2024-09-04 Chen Gong , Kecen Li , Jin Yao , Tianhao Wang

This work presents reinforcement learning (RL)-driven data augmentation to improve the generalization of vision-action (VA) models for dexterous grasping. While real-to-sim-to-real frameworks, where a few real demonstrations seed…

Robotics · Computer Science 2025-04-28 Atsushi Kanehira , Naoki Wake , Kazuhiro Sasabuchi , Jun Takamatsu , Katsushi Ikeuchi

Natural language processing (NLP) is a key component of intelligent transportation systems (ITS), but it faces many challenges in the transportation domain, such as domain-specific knowledge and data, and multi-modal inputs and outputs.…

Computation and Language · Computer Science 2024-02-13 Peng Wang , Xiang Wei , Fangxu Hu , Wenjuan Han

Accurate and robust trajectory prediction of neighboring agents is critical for autonomous vehicles traversing in complex scenes. Most methods proposed in recent years are deep learning-based due to their strength in encoding complex…

Robotics · Computer Science 2023-03-27 Yujun Jiao , Mingze Miao , Zhishuai Yin , Chunyuan Lei , Xu Zhu , Linzhen Nie , Bo Tao

Inverse reinforcement learning (IRL) aims to explicitly infer an underlying reward function based on collected expert demonstrations. Considering that obtaining expert demonstrations can be costly, the focus of current IRL techniques is on…

Machine Learning · Computer Science 2023-10-16 Lu Li , Yuxin Pan , Ruobing Chen , Jie Liu , Zilin Wang , Yu Liu , Zhiheng Li

City-scale traffic volume prediction plays a pivotal role in intelligent transportation systems, yet remains a challenge due to the inherent incompleteness and bias in observational data. Although deep learning-based methods have shown…

Machine Learning · Computer Science 2025-06-04 Shiyu Shen , Bin Pan , Guirong Xue

Model-based reinforcement learning (RL) is more sample efficient than model-free RL by using imaginary trajectories generated by the learned dynamics model. When the model is inaccurate or biased, imaginary trajectories may be deleterious…

Machine Learning · Computer Science 2021-04-12 Wenzhen Huang , Qiyue Yin , Junge Zhang , Kaiqi Huang

Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) is a powerful approach to solving Markov Decision Processes (MDPs) when the model of the environment is not known a priori. However, RL models are still faced with challenges…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Kabirat Olayemi , Mien Van , Luke Maguire , Sean McLoone

Train timetable rescheduling (TTR) aims to promptly restore the original operation of trains after unexpected disturbances or disruptions. Currently, this work is still done manually by train dispatchers, which is challenging to maintain…

Machine Learning · Computer Science 2024-01-17 Peng Yue , Yaochu Jin , Xuewu Dai , Zhenhua Feng , Dongliang Cui

The increasing demand for autonomous systems in complex and dynamic environments has driven significant research into intelligent path planning methodologies. For decades, graph-based search algorithms, linear programming techniques, and…

Curriculum Reinforcement Learning (CRL) aims to create a sequence of tasks, starting from easy ones and gradually learning towards difficult tasks. In this work, we focus on the idea of framing CRL as interpolations between a source…

Machine Learning · Computer Science 2022-10-20 Peide Huang , Mengdi Xu , Jiacheng Zhu , Laixi Shi , Fei Fang , Ding Zhao

Preference-based reinforcement learning (PbRL) has emerged as a promising paradigm for teaching robots complex behaviors without reward engineering. However, its effectiveness is often limited by two critical challenges: the reliance on…

Robotics · Computer Science 2025-12-02 Ruiqi Wang , Dezhong Zhao , Ziqin Yuan , Tianyu Shao , Guohua Chen , Dominic Kao , Sungeun Hong , Byung-Cheol Min

Reconstructing complete traffic flow time-space diagrams from vehicle trajectories offer a comprehensive view on traffic dynamics at arterial intersections. However, obtaining full trajectories across networks is costly, and accurately…

Systems and Control · Electrical Eng. & Systems 2025-11-21 Mengyun Xu , Jie Fang , Eui-Jin Kim , Tony Z. Qiu , Prateek Bansal

For autonomous vehicles, effective behavior planning is crucial to ensure safety of the ego car. In many urban scenarios, it is hard to create sufficiently general heuristic rules, especially for challenging scenarios that some new human…

Robotics · Computer Science 2020-11-11 Zhiqian Qiao , Jeff Schneider , John M. Dolan

Learning-based motion planning can quickly generate near-optimal trajectories. However, it often requires either large training datasets or costly collection of human demonstrations. This work proposes an alternative approach that quickly…

Robotics · Computer Science 2025-10-13 Dominik Urbaniak , Alejandro Agostini , Pol Ramon , Jan Rosell , Raúl Suárez , Michael Suppa

Simulation-based reinforcement learning (RL) has significantly advanced humanoid locomotion tasks, yet direct real-world RL from scratch or adapting from pretrained policies remains rare, limiting the full potential of humanoid robots.…

Robotics · Computer Science 2025-08-27 Kaizhe Hu , Haochen Shi , Yao He , Weizhuo Wang , C. Karen Liu , Shuran Song

Supervised open-loop training has been widely adopted for training traffic simulation models; however, it fails to capture the inherently dynamic, multi-agent interactions common in complex driving scenarios. We introduce RLFTSim, a…

Designing rewards for Reinforcement Learning (RL) is challenging because it needs to convey the desired task, be efficient to optimize, and be easy to compute. The latter is particularly problematic when applying RL to robotics, where…

Machine Learning · Computer Science 2020-05-28 Yiming Ding , Carlos Florensa , Mariano Phielipp , Pieter Abbeel

Path planning is an important problem with the the applications in many aspects, such as video games, robotics etc. This paper proposes a novel method to address the problem of Deep Reinforcement Learning (DRL) based path planning for a…

Robotics · Computer Science 2024-04-11 Hao Liu , Yi Shen , Shuangjiang Yu , Zijun Gao , Tong Wu