English
Related papers

Related papers: MambaLCT: Boosting Tracking via Long-term Context …

200 papers

Recent advances in deep learning have mainly relied on Transformers due to their data dependency and ability to learn at scale. The attention module in these architectures, however, exhibits quadratic time and space in input size, limiting…

Machine Learning · Computer Science 2024-07-25 Ali Behrouz , Michele Santacatterina , Ramin Zabih

How to effectively exploit spatio-temporal information is crucial to capture target appearance changes in visual tracking. However, most deep learning-based trackers mainly focus on designing a complicated appearance model or template…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Liangtao Shi , Bineng Zhong , Qihua Liang , Ning Li , Shengping Zhang , Xianxian Li

Visual object tracking has gained promising progress in past decades. Most of the existing approaches focus on learning target representation in well-conditioned daytime data, while for the unconstrained real-world scenarios with adverse…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Siyuan Yao , Rui Zhu , Ziqi Wang , Wenqi Ren , Yanyang Yan , Xiaochun Cao

Temporal point processes (TPPs) have emerged as powerful tools for modeling asynchronous event sequences. While recent advances have extended TPPs to handle textual information, existing approaches are limited in their ability to generate…

Computation and Language · Computer Science 2026-02-03 Jichu Li , Yilun Zhong , Zhiting Li , Feng Zhou , Quyu Kong

Time series prediction plays a pivotal role across diverse domains such as finance, healthcare, energy systems, and environmental modeling. However, existing approaches often struggle to balance efficiency, scalability, and accuracy,…

Machine Learning · Computer Science 2026-01-13 Xingsheng Chen , Regina Zhang , Bo Gao , Xingwei He , Xiaofeng Liu , Pietro Lio , Kwok-Yan Lam , Siu-Ming Yiu

In this paper, we focus on the multi-object tracking (MOT) problem of automatic driving and robot navigation. Most existing MOT methods track multiple objects using a singular RGB camera, which are prone to camera field-of-view and suffer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Yuhang He , Wentao Yu , Jie Han , Xing Wei , Xiaopeng Hong , Yihong Gong

Modeling long sequences is crucial for various large-scale models; however, extending existing architectures to handle longer sequences presents significant technical and resource challenges. In this paper, we propose an efficient and…

Computation and Language · Computer Science 2024-10-08 Ning Wang , Zekun Li , Tongxin Bai , Guoqi Li

Large language models have an exceptional capability to incorporate new information in a contextual manner. However, the full potential of such an approach is often restrained due to a limitation in the effective context length. One…

Computation and Language · Computer Science 2023-12-01 Szymon Tworkowski , Konrad Staniszewski , Mikołaj Pacek , Yuhuai Wu , Henryk Michalewski , Piotr Miłoś

Modern neural speech models benefit from having longer context, and many approaches have been proposed to increase the maximum context a model can use. However, few have attempted to measure how much context these models actually use, i.e.,…

Sound · Computer Science 2025-05-29 Yen Meng , Sharon Goldwater , Hao Tang

Combining traditional RGB cameras with bio-inspired event cameras for robust object tracking has garnered increasing attention in recent years. However, most existing multimodal tracking algorithms depend heavily on high-complexity Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shiao Wang , Ju Huang , Qingchuan Ma , Jinfeng Gao , Chunyi Xu , Xiao Wang , Lan Chen , Bo Jiang

Long-context language models unlock advanced capabilities in reasoning, code generation, and document summarization by leveraging dependencies across extended spans of text. However, a significant portion of readily available long-text data…

Computation and Language · Computer Science 2025-10-31 Haoran Deng , Yingyu Lin , Zhenghao Lin , Xiao Liu , Yizhou Sun , Yi-An Ma , Yeyun Gong

Object tracking becomes critical especially when similar objects are present in the same area. Recent state-of-the-art (SOTA) approaches are proposed based on taking a matching network with a heavy structure to distinguish the target from…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Faraz Lotfi , Hamid D. Taghirad

Video sequences offer valuable temporal information, but existing large multimodal models (LMMs) fall short in understanding extremely long videos. Many works address this by reducing the number of visual tokens using visual resamplers.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Peiyuan Zhang , Kaichen Zhang , Bo Li , Guangtao Zeng , Jingkang Yang , Yuanhan Zhang , Ziyue Wang , Haoran Tan , Chunyuan Li , Ziwei Liu

Long-term time-series forecasting remains challenging due to the difficulty in capturing long-term dependencies, achieving linear scalability, and maintaining computational efficiency. We introduce TimeMachine, an innovative model that…

Machine Learning · Computer Science 2024-08-26 Md Atik Ahamed , Qiang Cheng

Event cameras capture asynchronous pixel-level brightness changes with microsecond temporal resolution, offering unique advantages for high-speed vision tasks. Existing methods often convert event streams into intermediate representations…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Hanfang Liang , Bing Wang , Shizhen Zhang , Wen Jiang , Yizhuo Yang , Weixiang Guo , Shenghai Yuan

Large Language Models (LLMs) have made significant strides in text generation and comprehension, with recent advancements extending into multimodal LLMs that integrate visual and audio inputs. However, these models continue to struggle with…

Computation and Language · Computer Science 2024-10-17 Arushi Goel , Karan Sapra , Matthieu Le , Rafael Valle , Andrew Tao , Bryan Catanzaro

End-to-end transformer-based trackers have achieved remarkable performance on most human-related datasets. However, training these trackers in heterogeneous scenarios poses significant challenges, including negative interference - where the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Gianluca Mancusi , Mattia Bernardi , Aniello Panariello , Angelo Porrello , Rita Cucchiara , Simone Calderara

Boosting performance of the offline trained siamese trackers is getting harder nowadays since the fixed information of the template cropped from the first frame has been almost thoroughly mined, but they are poorly capable of resisting…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Zhihong Fu , Qingjie Liu , Zehua Fu , Yunhong Wang

Long context understanding remains challenging for large language models due to their limited context windows. This paper introduces Long Input Fine-Tuning (LIFT) for long context modeling, a novel framework that enhances LLM performance on…

Computation and Language · Computer Science 2024-12-19 Yansheng Mao , Jiaqi Li , Fanxu Meng , Jing Xiong , Zilong Zheng , Muhan Zhang

Human motion generation stands as a significant pursuit in generative computer vision, while achieving long-sequence and efficient motion generation remains challenging. Recent advancements in state space models (SSMs), notably Mamba, have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zeyu Zhang , Akide Liu , Ian Reid , Richard Hartley , Bohan Zhuang , Hao Tang