English
Related papers

Related papers: General Compression Framework for Efficient Transf…

200 papers

Achieving both efficiency and strong discriminative ability in lightweight visual tracking is a challenge, especially on mobile and edge devices with limited computational resources. Conventional lightweight trackers often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Juntao Liang , Jun Hou , Weijun Zhang , Yong Wang

Multi-Object Tracking (MOT) is a critical problem in computer vision, essential for understanding how objects move and interact in videos. This field faces significant challenges such as occlusions and complex environmental dynamics,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Luiz C. S. de Araujo , Carlos M. S. Figueiredo

Visual Transformers have achieved great success in almost all vision tasks, such as classification, detection, and so on. However, the model complexity and the inference speed of the visual transformers hinder their deployments in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Huan Yuan , Chao Liao , Jianchao Tan , Peng Yao , Jiyuan Jia , Bin Chen , Chengru Song , Di Zhang

Fast appearance variations and the distractions of similar objects are two of the most challenging problems in visual object tracking. Unlike many existing trackers that focus on modeling only the target, in this work, we consider the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Bi Li , Chengquan Zhang , Zhibin Hong , Xu Tang , Jingtuo Liu , Junyu Han , Errui Ding , Wenyu Liu

The smaller memory bandwidth in smart devices prompts development of smaller Automatic Speech Recognition (ASR) models. To obtain a smaller model, one can employ the model compression techniques. Knowledge distillation (KD) is a popular…

Sound · Computer Science 2022-10-04 Jash Rathod , Nauman Dawalatabad , Shatrughan Singh , Dhananjaya Gowda

In video object tracking, there exist rich temporal contexts among successive frames, which have been largely overlooked in existing trackers. In this work, we bridge the individual video frames and explore the temporal contexts across them…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Ning Wang , Wengang Zhou , Jie Wang , Houqaing Li

Tracking by detection paradigm is one of the most popular object tracking methods. However, it is very dependent on the performance of the detector. When the detector has a behavior of missing detection, the tracking result will be directly…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Zhibo Zou , Junjie Huang , Ping Luo

Communication compression techniques are of growing interests for solving the decentralized optimization problem under limited communication, where the global objective is to minimize the average of local cost functions over a multi-agent…

Optimization and Control · Mathematics 2022-05-26 Yiwei Liao , Zhuorui Li , Kun Huang , Shi Pu

A key capability of a long-term tracker is to search for targets in very large areas (typically the entire image) to handle possible target absences or tracking failures. However, currently there is a lack of such a strong baseline for…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Lianghua Huang , Xin Zhao , Kaiqi Huang

Recently, segmentation neural networks have been significantly improved by demonstrating very promising accuracies on public benchmarks. However, these models are very heavy and generally suffer from low inference speed, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Jiafeng Xie , Bing Shuai , Jian-Fang Hu , Jingyang Lin , Wei-Shi Zheng

Recent advances in transformer-based lightweight object tracking have established new standards across benchmarks, leveraging the global receptive field and powerful feature extraction capabilities of attention mechanisms. Despite these…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Junze Shi , Yang Yu , Jian Shi , Haibo Luo

Transformer-based trackers have achieved promising success and become the dominant tracking paradigm due to their accuracy and efficiency. Despite the substantial progress, most of the existing approaches tackle object tracking as a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Siyuan Yao , Yang Guo , Yanyang Yan , Wenqi Ren , Xiaochun Cao

Mainstream strategies for finetuning pretrained multimodal models often degrade out-of-distribution (OOD) robustness, a phenomenon known as catastrophic forgetting. In this paper, we develop a theoretical framework for multimodal…

Machine Learning · Computer Science 2026-05-29 Hesam Asadollahzadeh , Feng Liu , Christopher Leckie , Sarah M. Erfani

Recent spatio-temporal data applications, such as car-shar\-ing and smart cities, impose new challenges regarding the scalability and timeliness of data processing systems. Trajectory compression is a promising approach for scaling up…

Databases · Computer Science 2016-02-16 Arlei Silva , Ramya Raghavendra , Mudhakar Srivatsa , Ambuj K. Singh

Although large pre-trained models of code have delivered significant advancements in various code processing tasks, there is an impediment to the wide and fluent adoption of these powerful models in software developers' daily workflow:…

Software Engineering · Computer Science 2022-09-07 Jieke Shi , Zhou Yang , Bowen Xu , Hong Jin Kang , David Lo

The framework of dominant learned video compression methods is usually composed of motion prediction modules as well as motion vector and residual image compression modules, suffering from its complex structure and error propagation…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Zhenhong Sun , Zhiyu Tan , Xiuyu Sun , Fangyi Zhang , Dongyang Li , Yichen Qian , Hao Li

The remarkable performance gains realized by large pretrained models, e.g., GPT-3, hinge on the massive amounts of data they are exposed to during training. Analogously, distilling such large models to compact models for efficient…

Machine Learning · Computer Science 2022-08-16 Manzil Zaheer , Ankit Singh Rawat , Seungyeon Kim , Chong You , Himanshu Jain , Andreas Veit , Rob Fergus , Sanjiv Kumar

In scientific simulations, observations, and experiments, the cost of transferring data to and from disk and across networks has become a significant bottleneck that particularly impacts subsequent data analysis and visualization. To…

Databases · Computer Science 2023-08-24 Victor A. P. Magri , Peter Lindstrom

Training and deploying deepfake detection models on edge devices offers the advantage of maintaining data privacy and confidentiality by processing it close to its source. However, this approach is constrained by the limited computational…

Machine Learning · Computer Science 2025-05-01 Andreas Karathanasis , John Violos , Ioannis Kompatsiaris , Symeon Papadopoulos

LiDAR-based 3D single object tracking (3D SOT) is a critical task in robotics and autonomous systems. Existing methods typically follow frame-wise motion estimation or a sequence-based paradigm. However, the two-frame methods are efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 BaiChen Fan , Yuanxi Cui , Jian Li , Qin Wang , Shibo Zhao , Muqing Cao , Sifan Zhou