English
Related papers

Related papers: Exploiting Lightweight Hierarchical ViT and Dynami…

200 papers

Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Hanshuai Cui , Zhiqing Tang , Qianli Ma , Zhi Yao , Weijia Jia

Tracking multiple tiny objects is highly challenging due to their weak appearance and limited features. Existing multi-object tracking algorithms generally focus on single-modality scenes, and overlook the complementary characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Qingyu Xu , Longguang Wang , Weidong Sheng , Yingqian Wang , Chao Xiao , Chao Ma , Wei An

Recent Diffusion Transformers (DiTs) have shown impressive capabilities in generating high-quality single-modality content, including images, videos, and audio. However, it is still under-explored whether the transformer-based diffuser can…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Kai Wang , Shijian Deng , Jing Shi , Dimitrios Hatzinakos , Yapeng Tian

Accurate trajectory prediction is a cornerstone for the safe operation of autonomous driving systems, where understanding the dynamic behavior of surrounding agents is crucial. Transformer-based architectures have demonstrated significant…

Machine Learning · Computer Science 2025-05-07 JianLin Zhu , HongKuo Niu

Detection of video shot transition is a crucial pre-processing step in video analysis. Previous studies are restricted on detecting sudden content changes between frames through similarity measurement and multi-scale operations are widely…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Shitao Tang , Litong Feng , Zhangkui Kuang , Yimin Chen , Wei Zhang

We introduce JetViT, a novel family of hybrid-architecture Vision Transformer (ViT) models that match the accuracy of state-of-the-art full-attention vision foundation models while achieving substantially higher inference efficiency on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Dongyun Zou , Zhuoyang Zhang , Junyu Chen , Wenkun He , Qinhe Peng , Hanrong Ye , Yao Lu , Hongxu Yin , Yu Wang , Song Han , Han Cai

Single-modality tracking (RGB-only) struggles under low illumination, weather, and occlusion. Multimodal tracking addresses this by combining complementary cues. While Vision Transformer-based trackers achieve strong accuracy, they are…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Mahdi Falaki , Maria A. Amer

Predicting the trajectories of vehicles is crucial for the development of autonomous driving (AD) systems, particularly in complex and dynamic traffic environments. In this study, we introduce HiT (Human-like Trajectory Prediction), a novel…

Robotics · Computer Science 2025-05-29 Haicheng Liao , Zhenning Li , Guohui Zhang , Keqiang Li , Chengzhong Xu

Diffusion Transformers (DiT) have emerged as a powerful architecture for image and video generation, offering superior quality and scalability. However, their practical application suffers from inherent dynamic feature instability, leading…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Guanjie Chen , Xinyu Zhao , Yucheng Zhou , Xiaoye Qu , Tianlong Chen , Yu Cheng

High quality and high speed videography using Non-Line-of-Sight (NLOS) imaging benefit autonomous navigation, collision prevention, and post-disaster search and rescue tasks. Current solutions have to balance between the frame rate and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ruiqian Li , Siyuan Shen , Suan Xia , Ziheng Wang , Xingyue Peng , Chengxuan Song , Yingsheng Zhu , Tao Wu , Shiying Li , Jingyi Yu

Diffusion Transformer (DiT) has driven significant progress in image generation tasks. However, DiT inferencing is notoriously compute-intensive and incurs long latency even on datacenter-scale GPUs, primarily due to its iterative nature…

Hardware Architecture · Computer Science 2025-04-14 Daeun Kim , Jinwoo Hwang , Changhun Oh , Jongse Park

Diffusion Transformers (DiT) have established a new state-of-the-art in high-fidelity image synthesis; however, their massive computational complexity and memory requirements hinder local deployment on resource-constrained edge devices. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Sravanth Kodavanti , Manjunath Arveti , Sowmya Vajrala , Srinivas Miriyala , Vikram N R

In this paper, we propose a novel visual tracking framework that intelligently discovers reliable patterns from a wide range of video to resist drift error for long-term tracking tasks. First, we design a Discrete Fourier Transform (DFT)…

Computer Vision and Pattern Recognition · Computer Science 2016-02-19 Shu Wang , Shaoting Zhang , Wei Liu , Dimitris N. Metaxas

This paper introduces SFSORT, the world's fastest multi-object tracking system based on experiments conducted on MOT Challenge datasets. To achieve an accurate and computationally efficient tracker, this paper employs a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 M. M. Morsali , Z. Sharifi , F. Fallah , S. Hashembeiki , H. Mohammadzade , S. Bagheri Shouraki

Vision transformer (ViT) and its variants have swept through visual learning leaderboards and offer state-of-the-art accuracy in tasks such as image classification, object detection, and semantic segmentation by attending to different parts…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Eric Youn , Sai Mitheran J , Sanjana Prabhu , Siyuan Chen

Diffusion models are widely recognized for generating high-quality and diverse images, but their poor real-time performance has led to numerous acceleration works, primarily focusing on UNet-based structures. With the more successful…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Pengtao Chen , Mingzhu Shen , Peng Ye , Jianjian Cao , Chongjun Tu , Christos-Savvas Bouganis , Yiren Zhao , Tao Chen

Conventional multi-object tracking (MOT) systems are predominantly designed for pedestrian tracking and often exhibit limited generalization to other object categories. This paper presents a generalized tracking framework capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Hamidreza Hashempoor , Yu Dong Hwang

The deployment of transformers for visual object tracking has shown state-of-the-art results on several benchmarks. However, the transformer-based models are under-utilized for Siamese lightweight tracking due to the computational…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Goutam Yelluru Gopal , Maria A. Amer

Diffusion Transformers (DiTs) have achieved state-of-the-art performance in image and video generation, but their success comes at the cost of heavy computation. This inefficiency is largely due to the fixed tokenization process, which uses…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Dahye Kim , Deepti Ghadiyaram , Raghudeep Gadde

Diffusion transformers (DiTs) achieve high generative quality but lock FLOPs to image resolution, limiting principled latency-quality trade-offs, and allocate computation uniformly across input spatial tokens, wasting resource allocation to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Moayed Haji-Ali , Willi Menapace , Ivan Skorokhodov , Dogyun Park , Anil Kag , Michael Vasilkovsky , Sergey Tulyakov , Vicente Ordonez , Aliaksandr Siarohin