English
Related papers

Related papers: Arena: A Patch-of-Interest ViT Inference Accelerat…

200 papers

Video frame interpolation can up-convert the frame rate and enhance the video quality. In recent years, although the interpolation performance has achieved great success, image blur usually occurs at the object boundaries owing to the large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Bin Zhao , Xuelong Li

We investigate the robustness of vision transformers (ViTs) through the lens of their special patch-based architectural structure, i.e., they process an image as a sequence of image patches. We find that ViTs are surprisingly insensitive to…

Machine Learning · Computer Science 2023-02-23 Yao Qin , Chiyuan Zhang , Ting Chen , Balaji Lakshminarayanan , Alex Beutel , Xuezhi Wang

While recent face anti-spoofing methods perform well under the intra-domain setups, an effective approach needs to account for much larger appearance variations of images acquired in complex scenes with different sensors for robust…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Hsin-Ping Huang , Deqing Sun , Yaojie Liu , Wen-Sheng Chu , Taihong Xiao , Jinwei Yuan , Hartwig Adam , Ming-Hsuan Yang

Vision Transformers (ViTs) have achieved significant success in computer vision. However, their intensive computations and massive memory footprint challenge ViTs' deployment on embedded devices, calling for efficient ViTs. Among them,…

Hardware Architecture · Computer Science 2024-04-01 Haikuo Shao , Huihong Shi , Wendong Mao , Zhongfeng Wang

This work aims to improve the efficiency of vision transformers (ViT). While ViTs use computationally expensive self-attention operations in every layer, we identify that these operations are highly correlated across layers -- a key…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Shashanka Venkataramanan , Amir Ghodrati , Yuki M. Asano , Fatih Porikli , Amirhossein Habibian

While large deep neural networks excel at general video analytics tasks, the significant demand on computing capacity makes them infeasible for real-time inference on resource-constrained end cam-eras. In this paper, we propose an…

Multimedia · Computer Science 2023-09-01 Yuxin Kong , Peng Yang , Yan Cheng

Vision Transformers (ViTs) are becoming a very popular paradigm for vision tasks as they achieve state-of-the-art performance on image classification. However, although early works implied that this network structure had increased…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Hugo Lemarchant , Liangzi Li , Yiming Qian , Yuta Nakashima , Hajime Nagahara

While transformers have begun to dominate many tasks in vision, applying them to large images is still computationally difficult. A large reason for this is that self-attention scales quadratically with the number of tokens, which in turn,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Daniel Bolya , Cheng-Yang Fu , Xiaoliang Dai , Peizhao Zhang , Judy Hoffman

Over the past few years, vision transformers (ViTs) have consistently demonstrated remarkable performance across various visual recognition tasks. However, attempts to enhance their robustness have yielded limited success, mainly focusing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Nick Nikzad , Yi Liao , Yongsheng Gao , Jun Zhou

Vision Transformer (ViT) has shown high potential in video recognition, owing to its flexible design, adaptable self-attention mechanisms, and the efficacy of masked pre-training. Yet, it remains unclear how to adapt these pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Min Yang , Huan Gao , Ping Guo , Limin Wang

Vision-Language-Action (VLA) models have recently demonstrated impressive capabilities across various embodied AI tasks. While deploying VLA models on real-world robots imposes strict real-time inference constraints, the inference…

Robotics · Computer Science 2026-02-23 Wenqi Jiang , Jason Clemons , Karu Sankaralingam , Christos Kozyrakis

Edge Video Analytics (EVA) has gained significant attention as a major application of pervasive computing, enabling real-time visual processing. EVA pipelines, composed of deep neural networks (DNNs), typically demand efficient inference…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-04 Thanh-Tung Nguyen , Lucas Liebe , Nhat-Quang Tau , Yuheng Wu , Jinghan Cheng , Dongman Lee

Vision-Language-Action (VLA) models have demonstrated remarkable generalization capabilities in robotic manipulation tasks, yet their substantial computational overhead remains a critical obstacle to real-world deployment. Improving…

Robotics · Computer Science 2026-02-03 Yujie Wei , Jiahan Fan , Jiyu Guo , Ruichen Zhen , Rui Shao , Xiu Su , Zeke Xie , Shuo Yang

Accurate classification of celestial objects is essential for advancing our understanding of the universe. MargNet is a recently developed deep learning-based classifier applied to SDSS DR16 dataset to segregate stars, quasars, and compact…

Instrumentation and Methods for Astrophysics · Physics 2024-08-29 Srinadh Reddy Bhavanam , Sumohana S. Channappayya , P. K. Srijith , Shantanu Desai

We introduce an efficient video segmentation system for resource-limited edge devices leveraging heterogeneous compute. Specifically, we design network models by searching across multiple dimensions of specifications for the neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Jamie Menjay Lin , Siargey Pisarchyk , Juhyun Lee , David Tian , Tingbo Hou , Karthik Raveendran , Raman Sarokin , George Sung , Trent Tolley , Matthias Grundmann

We present ART$\boldsymbol{\cdot}$V, an efficient framework for auto-regressive video generation with diffusion models. Unlike existing methods that generate entire videos in one-shot, ART$\boldsymbol{\cdot}$V generates a single frame at a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Wenming Weng , Ruoyu Feng , Yanhui Wang , Qi Dai , Chunyu Wang , Dacheng Yin , Zhiyuan Zhao , Kai Qiu , Jianmin Bao , Yuhui Yuan , Chong Luo , Yueyi Zhang , Zhiwei Xiong

Vision transformers (ViT) have demonstrated impressive performance across various machine vision problems. These models are based on multi-head self-attention mechanisms that can flexibly attend to a sequence of image patches to encode…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Muzammal Naseer , Kanchana Ranasinghe , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang

Input aggregation is a simple technique used by state-of-the-art LiDAR 3D object detectors to improve detection. However, increasing aggregation is known to have diminishing returns and even performance degradation, due to objects…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Chengjie Huang , Vahdat Abdelzad , Sean Sedwards , Krzysztof Czarnecki

Visual Anomaly Detection (VAD) is a key task in industrial settings, where minimizing operational costs is essential. Deploying deep learning models within Internet of Things (IoT) environments introduces specific challenges due to limited…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Arianna Stropeni , Francesco Borsatti , Manuel Barusco , Davide Dalle Pezze , Marco Fabris , Gian Antonio Susto

Video, as a key driver in the global explosion of digital information, can create tremendous benefits for human society. Governments and enterprises are deploying innumerable cameras for a variety of applications, e.g., law enforcement,…

Networking and Internet Architecture · Computer Science 2023-10-12 Renjie Xu , Saiedeh Razavi , Rong Zheng