English
Related papers

Related papers: Recall to Predict: Grounding Motion Forecasting in…

200 papers

We present a feedforward graph architecture in which heterogeneous frozen large language models serve as computational nodes, communicating through a shared continuous latent space via learned linear projections. Building on recent work…

Machine Learning · Computer Science 2026-04-10 Marcus Armstrong , Navid Ayoobi , Arjun Mukherjee

Urban analytics increasingly relies on AI-driven trajectory analysis, yet current approaches suffer from methodological fragmentation: trajectory learning captures movement patterns but ignores spatial context, while spatial embedding…

Machine Learning · Computer Science 2025-12-04 Stephen Law , Tao Yang , Nanjiang Chen , Xuhui Lin

In this paper, we design a tracking model consisting of response generation and bounding box regression, where the first component produces a heat map to indicate the presence of the object at different positions and the second part…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Tianyu Yang , Pengfei Xu , Runbo Hu , Hua Chai , Antoni B. Chan

In autonomous driving, accurately interpreting the movements of other road users and leveraging this knowledge to forecast future trajectories is crucial. This is typically achieved through the integration of map data and tracked…

Robotics · Computer Science 2024-05-17 Tobias Demmler , Andreas Tamke , Thao Dang , Karsten Haug , Lars Mikelsons

Convolution neural networks and Transformers have their own advantages and both have been widely used for dense prediction in multi-task learning (MTL). Existing studies typically employ either CNNs (effectively capture local spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yangyang Xu , Yibo Yang , Bernard Ghanem , Lefei Zhang , Bo Du , Jun Zhu

We propose a motion forecasting model called BANet, which means Boundary-Aware Network, and it is a variant of LaneGCN. We believe that it is not enough to use only the lane centerline as input to obtain the embedding features of the vector…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Chen Zhang , Honglin Sun , Chen Chen , Yandong Guo

Multimodal large language models (MLLMs) have made significant advancements in vision understanding and reasoning. However, the autoregressive Transformer architecture used by MLLMs requries tokenization on input images, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Xiangxuan Ren , Zhongdao Wang , Liping Hou , Pin Tang , Guoqing Wang , Chao Ma

Anchor-based Siamese trackers have achieved remarkable advancements in accuracy, yet the further improvement is restricted by the lagged tracking robustness. We find the underlying reason is that the regression network in anchor-based…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Zhipeng Zhang , Houwen Peng , Jianlong Fu , Bing Li , Weiming Hu

The ability to flexibly bind features into coherent wholes from different perspectives is a hallmark of cognition and intelligence. Importantly, the binding problem is not only relevant for vision but also for general intelligence,…

Machine Learning · Computer Science 2021-10-19 Mahdi Sadeghi , Fabian Schrodt , Sebastian Otte , Martin V. Butz

Efficient and accurate motion prediction is crucial for ensuring safety and informed decision-making in autonomous driving, particularly under dynamic real-world conditions that necessitate multi-modal forecasts. We introduce TrajFlow, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Qi Yan , Brian Zhang , Yutong Zhang , Daniel Yang , Joshua White , Di Chen , Jiachao Liu , Langechuan Liu , Binnan Zhuang , Shaoshuai Shi , Renjie Liao

Despite recent success in incorporating learning into point cloud registration, many works focus on learning feature descriptors and continue to rely on nearest-neighbor feature matching and outlier filtering through RANSAC to obtain the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zi Jian Yew , Gim Hee Lee

Pedestrian trajectory prediction is a crucial component in computer vision and robotics, but remains challenging due to the domain shift problem. Previous studies have tried to tackle this problem by leveraging a portion of the trajectory…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yonghao Dong , Le Wang , Sanping Zhou , Gang Hua , Changyin Sun

Predicting multivariate time series is crucial, demanding precise modeling of intricate patterns, including inter-series dependencies and intra-series variations. Distinctive trend characteristics in each time series pose challenges, and…

Machine Learning · Computer Science 2024-07-08 Guoqi Yu , Jing Zou , Xiaowei Hu , Angelica I. Aviles-Rivero , Jing Qin , Shujun Wang

Locating an object in a sequence of frames, given its appearance in the first frame of the sequence, is a hard problem that involves many stages. Usually, state-of-the-art methods focus on bringing novel ideas in the visual encoding or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Omar Abdelaziz , Mohamed Sami Shehata

Motion forecasting plays a significant role in various domains (e.g., autonomous driving, human-robot interaction), which aims to predict future motion sequences given a set of historical observations. However, the observed elements may be…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Jiachen Li , Fan Yang , Hengbo Ma , Srikanth Malla , Masayoshi Tomizuka , Chiho Choi

This paper proposes an Adaptive Learning Model Predictive Control strategy for uncertain constrained linear systems performing iterative tasks. The additive uncertainty is modeled as the sum of a bounded process noise and an unknown…

Systems and Control · Computer Science 2018-04-27 Monimoy Bujarbaruah , Xiaojing Zhang , Ugo Rosolia , Francesco Borrelli

In decentralized learning networks, predictions from many participants are combined to generate a network inference. While many studies have demonstrated performance benefits of combining multiple model predictions, existing strategies…

Given a reference model that includes all the available variables, projection predictive inference replaces its posterior with a constrained projection including only a subset of all variables. We extend projection predictive inference to…

Computation · Statistics 2021-09-13 Alejandro Catalina , Paul Bürkner , Aki Vehtari

We explore whether useful temporal neural generative models can be learned from sequential data without back-propagation through time. We investigate the viability of a more neurocognitively-grounded approach in the context of unsupervised…

Machine Learning · Computer Science 2017-12-01 Alexander G. Ororbia , Patrick Haffner , David Reitter , C. Lee Giles

This work introduces a hierarchical strategy for terrain-aware bipedal locomotion that integrates reduced-dimensional perceptual representations to enhance reinforcement learning (RL)-based high-level (HL) policies for real-time gait…

Robotics · Computer Science 2025-12-16 Guillermo A. Castillo , Himanshu Lodha , Ayonga Hereid