English
Related papers

Related papers: Transforming Model Prediction for Tracking

200 papers

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Central to the success of Transformers is the attention block, which effectively models global dependencies among input tokens associated to a dataset. However, we theoretically demonstrate that standard attention mechanisms in transformers…

Machine Learning · Computer Science 2026-03-31 Hemanth Saratchandran

Predicting motion of surrounding agents is critical to real-world applications of tactical path planning for autonomous driving. Due to the complex temporal dependencies and social interactions of agents, on-line trajectory prediction is a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Jingwen Zhao , Xuanpeng Li , Qifan Xue , Weigong Zhang

Transformer-based models have improved visual tracking, but most still cannot run in real time on resource-limited devices, especially for unmanned aerial vehicle (UAV) tracking. To achieve a better balance between performance and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 You Wu , Yongxin Li , Mengyuan Liu , Xucheng Wang , Xiangyang Yang , Hengzhou Ye , Dan Zeng , Qijun Zhao , Shuiwang Li

Understanding Transformer-based models has attracted significant attention, as they lie at the heart of recent technological advances across machine learning. While most interpretability methods rely on running models over inputs, recent…

Computation and Language · Computer Science 2023-12-27 Guy Dar , Mor Geva , Ankit Gupta , Jonathan Berant

Transformer-based models for transfer learning have the potential to achieve high prediction accuracies on text-based supervised learning tasks with relatively few training data instances. These models are thus likely to benefit social…

Computation and Language · Computer Science 2022-09-01 Sandra Wankmüller

Tracking specific targets, such as pedestrians and vehicles, has been the focus of recent vision-based multitarget tracking studies. However, in some real-world scenarios, unseen categories often challenge existing methods due to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Zewei Wu , Longhao Wang , Cui Wang , César Teixeira , Wei Ke , Zhang Xiong

This study presents an innovative approach to predicting VCSEL emission characteristics using transformer neural networks. We demonstrate how to modify the transformer neural network for applications in physics. Our model achieved high…

Disordered Systems and Neural Networks · Physics 2025-09-17 Aleksei V. Belonovskii , Elizaveta I. Girshova , Erkki Lähderanta , Mikhail Kaliteevski

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

Machine Learning · Computer Science 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Modern agriculture faces escalating challenges: increasing demand for food, labor shortages, and the urgent need to reduce environmental impact. Agricultural robotics has emerged as a promising response to these pressures, enabling the…

Robotics · Computer Science 2025-06-23 Stephane Ngnepiepaye Wembe , Vincent Rousseau , Johann Laconte , Roland Lenain

Region proposal based methods like R-CNN and Faster R-CNN models have proven to be extremely successful in object detection and segmentation tasks. Recently, Transformers have also gained popularity in the domain of Computer Vision, and are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Deepanshu Pandey , Pradyumna Gupta , Sumit Bhattacharya , Aman Sinha , Rohit Agarwal

We present a new method that views object detection as a direct set prediction problem. Our approach streamlines the detection pipeline, effectively removing the need for many hand-designed components like a non-maximum suppression…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Nicolas Carion , Francisco Massa , Gabriel Synnaeve , Nicolas Usunier , Alexander Kirillov , Sergey Zagoruyko

Obstacle detection and tracking represent a critical component in robot autonomous navigation. In this paper, we propose ODTFormer, a Transformer-based model to address both obstacle detection and tracking problems. For the detection task,…

Robotics · Computer Science 2024-10-28 Tianye Ding , Hongyu Li , Huaizu Jiang

Urban traffic speed prediction aims to estimate the future traffic speed for improving the urban transportation services. Enormous efforts have been made on exploiting spatial correlations and temporal dependencies of traffic speed evolving…

Machine Learning · Computer Science 2022-12-27 Dongkun Wang , Wei Fan , Pengyang Wang , Pengfei Wang , Dongjie Wang , Denghui Zhang , Yanjie Fu

Context plays a significant role in the generation of motion for dynamic agents in interactive environments. This work proposes a modular method that utilises a learned model of the environment for motion prediction. This modularity…

Machine Learning · Computer Science 2021-01-05 Todor Davchev , Michael Burke , Subramanian Ramamoorthy

Model predictive control (MPC) is widely used for path tracking of autonomous vehicles due to its ability to handle various types of constraints. However, a considerable predictive error exists because of the error of mathematics model or…

Robotics · Computer Science 2020-07-21 Chaoyang Jiang , Hanqing Tian , Jibin Hu , Jiankun Zhai , Chao Wei , Jun Ni

Task-conditional architecture offers advantage in parameter efficiency but falls short in performance compared to state-of-the-art multi-decoder methods. How to trade off performance and model parameters is an important and difficult…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yuxiang Lu , Shalayiding Sirejiding , Yue Ding , Chunlin Wang , Hongtao Lu

Mobile applications and on-body devices are becoming increasingly ubiquitous tools for physical activity tracking. We propose utilizing a self-tracker's habits to support continuous prediction of whether they will reach their daily step…

Human-Computer Interaction · Computer Science 2016-10-19 Adam Wang , Steve Chang , John Wilson

We introduce a method for real-time navigation and tracking with differentiably rendered world models. Learning models for control has led to impressive results in robotics and computer games, but this success has yet to be extended to…

Machine Learning · Computer Science 2022-01-26 Baris Kayalibay , Atanas Mirchev , Patrick van der Smagt , Justin Bayer

Currently, domestic service robots have an insufficient ability to interact naturally through language. This is because understanding human instructions is complicated by various ambiguities and missing information. In existing methods, the…

Robotics · Computer Science 2021-07-05 Shintaro Ishikawa , Komei Sugiura