English
Related papers

Related papers: Recall to Predict: Grounding Motion Forecasting in…

200 papers

Many existing motion prediction approaches rely on symbolic perception outputs to generate agent trajectories, such as bounding boxes, road graph information and traffic lights. This symbolic representation is a high-level abstraction of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Norman Mu , Jingwei Ji , Zhenpei Yang , Nate Harada , Haotian Tang , Kan Chen , Charles R. Qi , Runzhou Ge , Kratarth Goel , Zoey Yang , Scott Ettinger , Rami Al-Rfou , Dragomir Anguelov , Yin Zhou

Anchor-based detectors have been continuously developed for object detection. However, the individual anchor box makes it difficult to predict the boundary's offset accurately. Instead of taking each bounding box as a closed individual, we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Yilong Lv , Min Li , Yujie He , Shaopeng Li , Zhuzhen He , Aitao Yang

Transformers process tokens in parallel but are temporally shallow: at position $t$, each layer attends to key-value pairs computed based on the previous layer, yielding a depth capped by the number of layers. Recurrent models offer…

Machine Learning · Computer Science 2026-04-24 Costin-Andrei Oncescu , Depen Morwani , Samy Jelassi , Alexandru Meterez , Mujin Kwun , Sham Kakade

LiDAR relocalization has attracted increasing attention as it can deliver accurate 6-DoF pose estimation in complex 3D environments. Recent learning-based regression methods offer efficient solutions by directly predicting global poses…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jianshi Wu , Minghang Zhu , Dunqiang Liu , Wen Li , Sheng Ao , Siqi Shen , Chenglu Wen , Cheng Wang

Trajectory planning in unstructured environments is a fundamental and challenging capability for mobile robots. Traditional modular pipelines suffer from latency and cascading errors across perception, localization, mapping, and planning…

Robotics · Computer Science 2025-12-24 Jiaqi Peng , Wenzhe Cai , Yuqiang Yang , Tai Wang , Yuan Shen , Jiangmiao Pang

Reliable forecasting of the future behavior of road agents is a critical component to safe planning in autonomous vehicles. Here, we represent continuous trajectories as sequences of discrete motion tokens and cast multi-agent motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Ari Seff , Brian Cera , Dian Chen , Mason Ng , Aurick Zhou , Nigamaa Nayakanti , Khaled S. Refaat , Rami Al-Rfou , Benjamin Sapp

Existing precipitation nowcasting methods typically adopt an autoregressive formulation, where future states are predicted from previous outputs. However, such an approach accumulates errors over long rollouts, causing forecasts to drift…

Machine Learning · Computer Science 2026-05-14 Penghui Wen , Yu Luo , Lintao Wang , Mengwei He , Patrick Filippi , Thomas Francis Bishop , Zhiyong Wang

Recent studies on transformer-based language models show that they can answer questions by reasoning over knowledge provided as part of the context (i.e., in-context reasoning). However, since the available knowledge is often not filtered…

Computation and Language · Computer Science 2023-11-07 Zeming Chen , Gail Weiss , Eric Mitchell , Asli Celikyilmaz , Antoine Bosselut

Time series foundation models (TSFMs) have recently achieved strong zero-shot forecasting performance through large-scale pretraining and retrieval-augmented prediction. However, our empirical analysis reveals a non-trivial limitation of…

Machine Learning · Computer Science 2026-05-26 Jinjin Chi , Lei Feng , Lulu Zhang , Yongcheng Jing , Yiming Wang , Ximing Li , Jialie Shen , Leszek Rutkowski , Dacheng Tao

Fine-tuning is the primary mechanism for adapting foundation models to downstream tasks; however, standard approaches largely optimize task objectives in isolation and do not account for secondary yet critical alignment objectives (e.g.,…

Machine Learning · Computer Science 2026-02-06 Gaurav Bhatt , Aditya Chinchure , Jiawei Zhou , Leonid Sigal

The deployment of pre-trained perception models in novel environments often leads to performance degradation due to distributional shifts. Although recent artificial intelligence approaches for metacognition use logical rules to…

Model Predictive Control (MPC) provides interpretable, tunable locomotion controllers grounded in physical models, but its robustness depends on frequent replanning and is limited by model mismatch and real-time computational constraints.…

Robotics · Computer Science 2025-10-15 Se Hwan Jeon , Ho Jae Lee , Seungwoo Hong , Sangbae Kim

Human motion prediction, which aims at predicting future human skeletons given the past ones, is a typical sequence-to-sequence problem. Therefore, extensive efforts have been continued on exploring different RNN-based encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Bin Li , Jian Tian , Zhongfei Zhang , Hailin Feng , Xi Li

Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede…

Atmospheric and Oceanic Physics · Physics 2024-03-29 Ruyi Yang , Jingyu Hu , Zihao Li , Jianli Mu , Tingzhao Yu , Jiangjiang Xia , Xuhong Li , Aritra Dasgupta , Haoyi Xiong

Multi-timescale sequence modeling relies on capturing both local fast dynamics and global slow context; yet, maintaining these capabilities under the strict memory constraints common to edge devices remains an open challenge. Current…

We present a novel motion generation approach for robot arms, with high degrees of freedom, in complex settings that can adapt online to obstacles or new via points. Learning from Demonstration facilitates rapid adaptation to new tasks and…

Developing natural and diverse locomotion controllers for quadruped robots that can adapt to complex terrains while preserving motion style remains a significant challenge. Existing imitation-based methods face a fundamental optimization…

Robotics · Computer Science 2026-04-21 Zhiquan Wang , Yunyu Liu , Dipam Patel , Ayush Kumar , Aniket Bera , Bedrich Benes

Numerical reasoning over natural language has been a long-standing goal for the research community. However, cutting-edge language models have proven difficult to reliably generalize to a broad range of numbers, although they have shown…

Computation and Language · Computer Science 2022-10-12 Fan Zhou , Haoyu Dong , Qian Liu , Zhoujun Cheng , Shi Han , Dongmei Zhang

The stability-plasticity dilemma is a major challenge in continual learning, as it involves balancing the conflicting objectives of maintaining performance on previous tasks while learning new tasks. In this paper, we propose the…

Machine Learning · Computer Science 2024-03-06 Haneol Kang , Dong-Wan Choi

Traditional target tracking pipelines including detection, mapping, navigation, and control are comprehensive but introduce high latency, limitting the agility of quadrotors. On the contrary, we follow the design principle of "less is…

Robotics · Computer Science 2025-05-13 Junjie Lu , Yulin Hui , Xuewei Zhang , Wencan Feng , Hongming Shen , Zhiyu Li , Bailing Tian
‹ Prev 1 4 5 6 7 8 10 Next ›