English
Related papers

Related papers: Efficient Joint Prediction of Multiple Future Toke…

200 papers

Spatiotemporal forecasting is critical for real-world applications like traffic management, yet capturing reliable interactions remains challenging under noisy and non-stationary conditions. Existing methods primarily rely on historical…

Machine Learning · Computer Science 2026-05-20 Yinghao Ai , Yukai Zhou , Ruoxi Jiang , Junyi An , Chao Qu , Zhijian Zhou , Shiyu Wang , Fenglei Cao , Zenglin Xu , Furao Shen , Yuan Qi

Multi-Object Tracking (MOT) has been a long-standing challenge in video understanding. A natural and intuitive approach is to split this task into two parts: object detection and association. Most mainstream methods employ meticulously…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ruopeng Gao , Ji Qi , Limin Wang

Human activities generate various event sequences such as taxi trip records, bike-sharing pick-ups, crime occurrence, and infectious disease transmission. The point process is widely used in many applications to predict such events related…

Machine Learning · Computer Science 2024-01-30 Yoshiaki Takimoto , Yusuke Tanaka , Tomoharu Iwata , Maya Okawa , Hideaki Kim , Hiroyuki Toda , Takeshi Kurashima

In this work we introduce a new framework for performing temporal predictions in the presence of uncertainty. It is based on a simple idea of disentangling components of the future state which are predictable from those which are inherently…

Artificial Intelligence · Computer Science 2017-12-04 Mikael Henaff , Junbo Zhao , Yann LeCun

Transformers replace recurrence with a memory that grows with sequence length and self-attention that enables ad-hoc lookups over past tokens. Consequently, they lack an inherent incentive to compress history into compact latent states with…

We propose the task Future Object Detection, in which the goal is to predict the bounding boxes for all visible objects in a future video frame. While this task involves recognizing temporal and kinematic patterns, in addition to the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Adam Tonderski , Joakim Johnander , Christoffer Petersson , Kalle Åström

Semantic Tube Prediction (STP) leverages representation geometric to regularize LLM hidden-state trajectories toward locally linear geodesics during fine-tuning, thereby greatly improving data efficiency. The original STP recipe samples…

Machine Learning · Computer Science 2026-04-21 Yidi Yuan

Trajectory prediction is an important task, especially in autonomous driving. The ability to forecast the position of other moving agents can yield to an effective planning, ensuring safety for the autonomous vehicle as well for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Lorenzo Berlincioni , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo

Recently, the topic of table pre-training has attracted considerable research interest. However, how to employ table pre-training to boost the performance of tabular prediction remains an open challenge. In this paper, we propose TapTap,…

Machine Learning · Computer Science 2023-05-18 Tianping Zhang , Shaowen Wang , Shuicheng Yan , Jian Li , Qian Liu

Multivariate time series forecasting is widely used in various fields. Reasonable prediction results can assist people in planning and decision-making, generate benefits and avoid risks. Normally, there are two characteristics of time…

Machine Learning · Computer Science 2021-03-23 Yifu Zhou , Ziheng Duan , Haoyan Xu , Jie Feng , Anni Ren , Yueyang Wang , Xiaoqian Wang

Predicting the future behavior of moving agents is essential for real world applications. It is challenging as the intent of the agent and the corresponding behavior is unknown and intrinsically multimodal. Our key insight is that for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Hang Zhao , Jiyang Gao , Tian Lan , Chen Sun , Benjamin Sapp , Balakrishnan Varadarajan , Yue Shen , Yi Shen , Yuning Chai , Cordelia Schmid , Congcong Li , Dragomir Anguelov

Recently, there has been tremendous progress in developing each individual module of the standard perception-planning robot autonomy pipeline, including detection, tracking, prediction of other agents' trajectories, and ego-agent trajectory…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Xinshuo Weng , Boris Ivanovic , Marco Pavone

Tracking Any Point (TAP) in a video is a challenging computer vision problem with many demonstrated applications in robotics, video editing, and 3D reconstruction. Existing methods for TAP rely heavily on complex tracking-specific inductive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Artem Zholus , Carl Doersch , Yi Yang , Skanda Koppula , Viorica Patraucean , Xu Owen He , Ignacio Rocco , Mehdi S. M. Sajjadi , Sarath Chandar , Ross Goroshin

Tracking by detection has been the prevailing paradigm in the field of Multi-object Tracking (MOT). These methods typically rely on the Kalman Filter to estimate the future locations of objects, assuming linear object motion. However, they…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Changcheng Xiao , Qiong Cao , Zhigang Luo , Long Lan

Traffic flow forecasting has emerged as an indispensable mission for daily life, which is required to utilize the spatiotemporal relationship between each location within a time period under a graph structure to predict future flow.…

Machine Learning · Computer Science 2026-02-27 Runfei Chen

Predicting the future behavior of road users is one of the most challenging and important problems in autonomous driving. Applying deep learning to this problem requires fusing heterogeneous world state in the form of rich perception…

Tokenization in video models, typically through patchification, generates an excessive and redundant number of tokens. This severely limits video efficiency and scalability. While recent trajectory-based tokenizers offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chenhao Zheng , Jieyu Zhang , Jianing Zhang , Weikai Huang , Ashutosh Kumar , Quan Kong , Oncel Tuzel , Chun-Liang Li , Ranjay Krishna

Although traditional symbolic reasoning methods are highly interpretable, their application in knowledge graphs link prediction has been limited due to their computational inefficiency. A new RNNNTP method is proposed in this paper, using a…

Machine Learning · Computer Science 2022-03-15 Yu-hao Wu , Hou-biao Li

Temporal prediction is critical for making intelligent and robust decisions in complex dynamic environments. Motion prediction needs to model the inherently uncertain future which often contains multiple potential outcomes, due to…

Machine Learning · Computer Science 2019-12-10 Yichuan Charlie Tang , Ruslan Salakhutdinov

Multi-target tracking (MTT) is a classical signal processing task, where the goal is to estimate the states of an unknown number of moving targets from noisy sensor measurements. In this paper, we revisit MTT from a deep learning…

Signal Processing · Electrical Eng. & Systems 2024-05-15 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro