English
Related papers

Related papers: FreqTrack: Frequency Learning based Vision Transfo…

200 papers

In sound event detection (SED), convolutional neural networks (CNNs) are widely employed to extract time-frequency (TF) patterns from spectrograms. However, the ability of CNNs to recognize different sound events is limited by their…

Sound · Computer Science 2024-10-30 Tao Song , WenWen Zhang

Visual tracking often faces challenges such as invalid targets and decreased performance in low-light conditions when relying solely on RGB image sequences. While incorporating additional modalities like depth and infrared data has proven…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Lei Liu , Mengya Zhang , Cheng Li , Chenglong Li , Jin Tang

Multimodal visual object tracking can be divided into to several kinds of tasks (e.g. RGB and RGB+X tracking), based on the input modality. Existing methods often train separate models for each modality or rely on pretrained models to adapt…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Lingyi Hong , Jinglun Li , Xinyu Zhou , Kaixun Jiang , Pinxue Guo , Zhaoyu Chen , Runze Li , Xingdong Sheng , Wenqiang Zhang

Accurate tracking of transparent objects, such as glasses, plays a critical role in many robotic tasks such as robot-assisted living. Due to the adaptive and often reflective texture of such objects, traditional tracking algorithms that…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Kalyan Garigapati , Erik Blasch , Jie Wei , Haibin Ling

Conventional multi-object tracking (MOT) systems are predominantly designed for pedestrian tracking and often exhibit limited generalization to other object categories. This paper presents a generalized tracking framework capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Hamidreza Hashempoor , Yu Dong Hwang

The speed-precision trade-off is a critical problem for visual object tracking which usually requires low latency and deployment on constrained resources. Existing solutions for efficient tracking mainly focus on adopting light-weight…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Jiawen Zhu , Xin Chen , Haiwen Diao , Shuai Li , Jun-Yan He , Chenyang Li , Bin Luo , Dong Wang , Huchuan Lu

The Transformer model has shown leading performance in time series forecasting. Nevertheless, in some complex scenarios, it tends to learn low-frequency features in the data and overlook high-frequency features, showing a frequency bias.…

Machine Learning · Computer Science 2024-07-04 Xihao Piao , Zheng Chen , Taichi Murayama , Yasuko Matsubara , Yasushi Sakurai

Multi-agent collaborative perception has emerged as a widely recognized technology in the field of autonomous driving in recent years. However, current collaborative perception predominantly relies on LiDAR point clouds, with significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shaohong Wang , Lu Bin , Xinyu Xiao , Zhiyu Xiang , Hangguan Shan , Eryun Liu

Event-based vision sensors, inspired by biological neural systems, asynchronously capture local pixel-level intensity changes as a sparse event stream containing position, polarity, and timestamp information. These neuromorphic sensors…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Tiantian Xie , Pengpai Wang , Rosa H. M. Chan

Ensuring robust and real-time obstacle avoidance is critical for the safe operation of autonomous robots in dynamic, real-world environments. This paper proposes a neural network framework for predicting the time and collision position of…

Face analysis has been studied from different angles to infer emotion, poses, shapes, and landmarks. Traditionally RGB cameras are used, yet for fine-grained tasks standard sensors might not be up to the task due to their latency, making it…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Luca Cultrera , Federico Becattini , Lorenzo Berlincioni , Claudio Ferrari , Alberto Del Bimbo

To fully leverage spatial information for remote sensing image segmentation and address semantic edge ambiguities caused by grayscale variations (e.g., shadows and low-contrast regions), we propose the Frequency and Spatial Domains based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Jiahao Fu , Yinfeng Yu , Liejun Wang

Referring Multi-Object Tracking has attracted increasing attention due to its human-friendly interactive characteristics, yet it exhibits limitations in low-visibility conditions, such as nighttime, smoke, and other challenging scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Yanqiu Yu , Zhifan Jin , Sijia Chen , Tongfei Chu , En Yu , Liman Liu , Wenbing Tao

Event cameras, or dynamic vision sensors, have recently achieved success from fundamental vision tasks to high-level vision researches. Due to its ability to asynchronously capture light intensity changes, event camera has an inherent…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Yingkai Fu , Meng Li , Wenxi Liu , Yuanchen Wang , Jiqing Zhang , Baocai Yin , Xiaopeng Wei , Xin Yang

We present a novel adaptive multi-modal intensity-event algorithm to optimize an overall objective of object tracking under bit rate constraints for a host-chip architecture. The chip is a computationally resource constrained device…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 Srutarshi Banerjee , Henry H. Chopp , Jianping Zhang , Zihao W. Wang , Oliver Cossairt , Aggelos Katsaggelos

Reconstructing natural images from functional magnetic resonance imaging (fMRI) data remains a core challenge in natural decoding due to the mismatch between the richness of visual stimuli and the noisy, low resolution nature of fMRI…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Junliang Ye , Lei Wang , Md Zakir Hossain

Automated design of efficient transformer models has recently attracted significant attention from industry and academia. However, most works only focus on certain metrics while searching for the best-performing transformer architecture.…

Machine Learning · Computer Science 2023-03-27 Shikhar Tuli , Niraj K. Jha

Time series data can be represented in both the time and frequency domains, with the time domain emphasizing local dependencies and the frequency domain highlighting global dependencies. To harness the strengths of both domains in capturing…

Machine Learning · Computer Science 2024-08-13 Zhengnan Li , Yunxiao Qin , Xilong Cheng , Yuting Tan

Multi-object tracking (MOT) is a vital component of intelligent video analytics applications such as surveillance and autonomous driving. The time and storage complexity required to execute deep learning models for visual object tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Keivan Nalaie , Rong Zheng

RGB-Thermal (RGB-T) object tracking receives more and more attention due to the strongly complementary benefits of thermal information to visible data. However, RGB-T research is limited by lacking a comprehensive evaluation platform. In…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Chenglong Li , Xinyan Liang , Yijuan Lu , Nan Zhao , Jin Tang