English
Related papers

Related papers: RMP: A Random Mask Pretrain Framework for Motion P…

200 papers

Trajectory prediction has been a crucial task in building a reliable autonomous driving system by anticipating possible dangers. One key issue is to generate consistent trajectory predictions without colliding. To overcome the challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Hao Chen , Jiaze Wang , Kun Shao , Furui Liu , Jianye Hao , Chenyong Guan , Guangyong Chen , Pheng-Ann Heng

Video prediction, forecasting the future frames from a sequence of input frames, is a challenging task since the view changes are influenced by various factors, such as the global context surrounding the scene and local motion dynamics. In…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jaehoon Cho , Jiyoung Lee , Changjae Oh , Wonil Song , Kwanghoon Sohn

With growing numbers of intelligent autonomous systems in human environments, the ability of such systems to perceive, understand and anticipate human behavior becomes increasingly important. Specifically, predicting future positions of…

Robotics · Computer Science 2020-07-27 Andrey Rudenko , Luigi Palmieri , Michael Herman , Kris M. Kitani , Dariu M. Gavrila , Kai O. Arras

Recent unsupervised pre-training methods have shown to be effective on language and vision domains by learning useful representations for multiple downstream tasks. In this paper, we investigate if such unsupervised pre-training methods can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Younggyo Seo , Kimin Lee , Stephen James , Pieter Abbeel

In a given scenario, simultaneously and accurately predicting every possible interaction of traffic participants is an important capability for autonomous vehicles. The majority of current researches focused on the prediction of an single…

Machine Learning · Computer Science 2018-10-31 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

This paper presents a Predictive Maneuver Planning with Deep Reinforcement Learning (PMP-DRL) model for maneuver planning. Traditional rule-based maneuver planning approaches often have to improve their abilities to handle the variabilities…

Language plays a vital role in the realm of human motion. Existing methods have largely depended on CLIP text embeddings for motion generation, yet they fall short in effectively aligning language and motion due to CLIP's pretraining on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Zhe Li , Weihao Yuan , Yisheng He , Lingteng Qiu , Shenhao Zhu , Xiaodong Gu , Weichao Shen , Yuan Dong , Zilong Dong , Laurence T. Yang

Accurate human trajectory prediction is crucial for applications such as autonomous vehicles, robotics, and surveillance systems. Yet, existing models often fail to fully leverage the non-verbal social cues human subconsciously communicate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Saeed Saadatnejad , Yang Gao , Kaouther Messaoud , Alexandre Alahi

Reliable prediction of surround vehicle motion is a critical requirement for path planning for autonomous vehicles. In this paper we propose a unified framework for surround vehicle maneuver classification and motion prediction that…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Nachiket Deo , Akshay Rangesh , Mohan M. Trivedi

Context plays a significant role in the generation of motion for dynamic agents in interactive environments. This work proposes a modular method that utilises a learned model of the environment for motion prediction. This modularity…

Machine Learning · Computer Science 2021-01-05 Todor Davchev , Michael Burke , Subramanian Ramamoorthy

We present Masked Frequency Modeling (MFM), a unified frequency-domain-based approach for self-supervised pre-training of visual models. Instead of randomly inserting mask tokens to the input embeddings in the spatial domain, in this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Jiahao Xie , Wei Li , Xiaohang Zhan , Ziwei Liu , Yew Soon Ong , Chen Change Loy

Masked video modeling (MVM) has emerged as a simple and scalable self-supervised pretraining paradigm, but only encodes motion information implicitly, limiting the encoding of temporal dynamics in the learned representations. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Renaud Vandeghen , Fida Mohammad Thoker , Marc Van Droogenbroeck , Bernard Ghanem

Situational awareness in vehicular networks could be substantially improved utilizing reliable trajectory prediction methods. More precise situational awareness, in turn, results in notably better performance of critical safety…

Robotics · Computer Science 2018-08-03 Hossein Nourkhiz Mahjoub , Amin Tahmasbi-Sarvestani , Hadi Kazemi , Yaser P. Fallah

Trajectory prediction is a pivotal component of autonomous driving systems, enabling the application of accumulated movement experience to current scenarios. Although most existing methods concentrate on learning continuous representations…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Hang Guo , Yuzhen Zhang , Tianci Gao , Junning Su , Pei Lv , Mingliang Xu

Masked language modeling (MLM) is one of the key sub-tasks in vision-language pretraining. In the cross-modal setting, tokens in the sentence are masked at random, and the model predicts the masked tokens given the image and the text. In…

Computation and Language · Computer Science 2021-09-07 Yonatan Bitton , Gabriel Stanovsky , Michael Elhadad , Roy Schwartz

In urban computing, precise and swift forecasting of multivariate time series data from traffic networks is crucial. This data incorporates additional spatial contexts such as sensor placements and road network layouts, and exhibits complex…

Machine Learning · Computer Science 2024-12-19 Tongtong Zhang , Zhiyong Cui , Bingzhang Wang , Yilong Ren , Haiyang Yu , Pan Deng , Yinhai Wang

We have developed a new framework using time-series analysis for dynamically assigning mobile network traffic prediction models in previously unseen wireless environments. Our framework selectively employs learned behaviors, outperforming…

Information Theory · Computer Science 2023-12-01 Alexander Downey , Evren Tuna , Alkan Soysal

Accurately tracking and predicting behaviors of surrounding objects are key prerequisites for intelligent systems such as autonomous vehicles to achieve safe and high-quality decision making and motion planning. However, there still remain…

Robotics · Computer Science 2020-03-31 Jiachen Li , Wei Zhan , Yeping Hu , Masayoshi Tomizuka

Robotic motor control necessitates the ability to predict the dynamics of environments and interaction objects. However, advanced self-supervised pre-trained visual representations in robotic motor control, leveraging large-scale egocentric…

Robotics · Computer Science 2024-11-25 Jiange Yang , Bei Liu , Jianlong Fu , Bocheng Pan , Gangshan Wu , Limin Wang

Neural network (NN)-based methods have emerged as an attractive approach for robot motion planning due to strong learning capabilities of NN models and their inherently high parallelism. Despite the current development in this direction,…

Robotics · Computer Science 2022-08-25 Xiao Zang , Miao Yin , Lingyi Huang , Jingjin Yu , Saman Zonouz , Bo Yuan