English
Related papers

Related papers: SEPT: Towards Efficient Scene Representation Learn…

200 papers

Traffic prediction is a cornerstone of modern intelligent transportation systems and a critical task in spatio-temporal forecasting. Although advanced Spatio-temporal Graph Neural Networks (STGNNs) and pre-trained models have achieved…

Machine Learning · Computer Science 2026-01-01 Weilin Ruan , Xilin Dang , Ziyu Zhou , Sisuo Lyu , Yuxuan Liang

In dynamic traffic environments, motion forecasting models must be able to accurately estimate future trajectories continuously. Streaming-based methods are a promising solution, but despite recent advances, their performance often degrades…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Alexander Prutsch , Christian Fruhwirth-Reisinger , David Schinagl , Horst Possegger

Motion prediction systems aim to capture the future behavior of traffic scenarios enabling autonomous vehicles to perform safe and efficient planning. The evolution of these scenarios is highly uncertain and depends on the interactions of…

Artificial Intelligence · Computer Science 2022-12-08 Sandra Carrasco Limeros , Sylwia Majchrowska , Joakim Johnander , Christoffer Petersson , David Fernández Llorca

The ability to predict and therefore to anticipate the future is an important attribute of intelligence. It is also of utmost importance in real-time systems, e.g. in robotics or autonomous driving, which depend on visual scene…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Pauline Luc , Natalia Neverova , Camille Couprie , Jakob Verbeek , Yann LeCun

Robotic motor control necessitates the ability to predict the dynamics of environments and interaction objects. However, advanced self-supervised pre-trained visual representations in robotic motor control, leveraging large-scale egocentric…

Robotics · Computer Science 2024-11-25 Jiange Yang , Bei Liu , Jianlong Fu , Bocheng Pan , Gangshan Wu , Limin Wang

Intelligent agent naturally learns from motion. Various self-supervised algorithms have leveraged motion cues to learn effective visual representations. The hurdle here is that motion is both ambiguous and complex, rendering previous works…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Xiaohang Zhan , Xingang Pan , Ziwei Liu , Dahua Lin , Chen Change Loy

Predicting the future motion of observed vehicles is a crucial enabler for safe autonomous driving. The field of motion prediction has seen large progress recently with state-of-the-Art (sotA) models achieving impressive results on…

Robotics · Computer Science 2024-04-19 Marcel Hallgarten , Ismail Kisa , Martin Stoll , Andreas Zell

Robots act in their environment through sequences of continuous motor commands. Because of the dimensionality of the motor space, as well as the infinite possible combinations of successive motor commands, agents need compact…

Robotics · Computer Science 2018-05-17 Michael Garcia Ortiz , Alban Laflaquière

Trajectory prediction in autonomous driving relies on accurate representation of all relevant contexts of the driving scene, including traffic participants, road topology, traffic signs, as well as their semantic relations to each other.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Zhigang Sun , Zixu Wang , Lavdim Halilaj , Juergen Luettin

Existing self-supervised learning (SSL) methods primarily learn object-invariant representations but often neglect the spatial structure and relationships among object parts. To address this limitation, we introduce Spatial Prediction (SP),…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yang Shen , Yusen Cai , Weronika Hryniewska-Guzik , Qing Lin , Mengmi Zhang

Being able to perceive the semantics and the spatial structure of the environment is essential for visual navigation of a household robot. However, most existing works only employ visual backbones pre-trained either with independent images…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yicong Hong , Yang Zhou , Ruiyi Zhang , Franck Dernoncourt , Trung Bui , Stephen Gould , Hao Tan

Predicting traffic conditions has been recently explored as a way to relieve traffic congestion. Several pioneering approaches have been proposed based on traffic observations of the target location as well as its adjacent regions, but they…

Artificial Intelligence · Computer Science 2023-08-22 Xingyi Cheng , Ruiqing Zhang , Jie Zhou , Wei Xu

Autonomous vehicles navigate in dynamically changing environments under a wide variety of conditions, being continuously influenced by surrounding objects. Modelling interactions among agents is essential for accurately forecasting other…

Machine Learning · Computer Science 2021-06-01 Sandra Carrasco , David Fernández Llorca , Miguel Ángel Sotelo

We present Flex, an efficient and effective scene encoder that addresses the computational bottleneck of processing high-volume multi-camera data in end-to-end autonomous driving. Flex employs a small set of learnable scene tokens to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Jiawei Yang , Ziyu Chen , Yurong You , Yan Wang , Yiming Li , Yuxiao Chen , Boyi Li , Boris Ivanovic , Marco Pavone , Yue Wang

In recent years, the concept of artificial intelligence (AI) has become a prominent keyword because it is promising in solving complex tasks. The need for human expertise in specific areas may no longer be needed because machines have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Ehsan Rassekh

Road obstacle detection is an important problem for vehicle driving safety. In this paper, we aim to obtain robust road obstacle detection based on spatio-temporal context modeling. Firstly, a data-driven spatial context model of the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-20 Xiuen Wu , Tao Wang , Lingyu Liang , Zuoyong Li , Fum Yew Ching

Accurate and fast scene understanding is one of the challenging task for autonomous driving, which requires to take full advantage of LiDAR point clouds for semantic segmentation. In this paper, we present a \textbf{concise} and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Hui-Xian Cheng , Xian-Feng Han , Guo-Qiang Xiao

We propose an architecture and training scheme to predict video frames by explicitly modeling dis-occlusions and capturing the evolution of semantically consistent regions in the video. The scene layout (semantic map) and motion (optical…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Xinzhu Bei , Yanchao Yang , Stefano Soatto

Traffic forecasting is a challenging task due to the complex spatio-temporal correlations among traffic series. In this paper, we identify an underexplored problem in multivariate traffic series prediction: extreme events. Road congestion…

Machine Learning · Computer Science 2023-09-19 Zhiwei Zhang , Weizhong Zhang , Yaowei Huang , Kani Chen

Future trajectories of neighboring traffic agents have a significant influence on the path planning and decision-making of autonomous vehicles. While trajectory forecasting is a well-studied field, research mainly focuses on snapshot-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Alexander Prutsch , David Schinagl , Horst Possegger