English

FreqTrack: Frequency Learning based Vision Transformer for RGB-Event Object Tracking

Computer Vision and Pattern Recognition 2026-04-17 v1

Abstract

Existing single-modal RGB trackers often face performance bottlenecks in complex dynamic scenes, while the introduction of event sensors offers new potential for enhancing tracking capabilities. However, most current RGB-event fusion methods, primarily designed in the spatial domain using convolutional, Transformer, or Mamba architectures, fail to fully exploit the unique temporal response and high-frequency characteristics of event data. To address this, we1 propose FreqTrack, a frequency-aware RGBE tracking framework that establishes complementary inter-modal correlations through frequency-domain transformations for more robust feature fusion. We design a Spectral Enhancement Transformer (SET) layer that incorporates multi-head dynamic Fourier filtering to adaptively enhance and select frequency-domain features. Additionally, we develop a Wavelet Edge Refinement (WER) module, which leverages learnable wavelet transforms to explicitly extract multi-scale edge structures from event data, effectively improving modeling capability in high-speed and low-light scenarios. Extensive experiments on the COESOT and FE108 datasets demonstrate that FreqTrack achieves highly competitive performance, particularly attaining leading precision of 76.6\% on the COESOT benchmark, validating the effectiveness of frequency-domain modeling for RGBE tracking.

Keywords

Cite

@article{arxiv.2604.14526,
  title  = {FreqTrack: Frequency Learning based Vision Transformer for RGB-Event Object Tracking},
  author = {Jinlin You and Muyu Li and Xudong Zhao},
  journal= {arXiv preprint arXiv:2604.14526},
  year   = {2026}
}
R2 v1 2026-07-01T12:11:51.378Z