English
Related papers

Related papers: CAKE: Real-time Action Detection via Motion Distil…

200 papers

Radar-camera fusion methods have emerged as a cost-effective approach for 3D object detection but still lag behind LiDAR-based methods in performance. Recent works have focused on employing temporal fusion and Knowledge Distillation (KD)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Geonho Bang , Minjae Seong , Jisong Kim , Geunju Baek , Daye Oh , Junhyung Kim , Junho Koh , Jun Won Choi

Distribution Matching Distillation (DMD) is a promising score distillation technique that compresses pre-trained teacher diffusion models into efficient one-step or multi-step student generators. Nevertheless, its reliance on the reverse…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Yanzuo Lu , Yuxi Ren , Xin Xia , Shanchuan Lin , Xing Wang , Xuefeng Xiao , Andy J. Ma , Xiaohua Xie , Jian-Huang Lai

Online action detection (OAD) aims to identify ongoing actions from streaming video in real-time, without access to future frames. Since these actions manifest at varying scales of granularity, ranging from coarse to fine, projecting an…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Zhipeng Yang , Ruoyu Wang , Yang Tan , Liping Xie

RGB-D salient object detection (SOD) demonstrates its superiority on detecting in complex environments due to the additional depth information introduced in the data. Inevitably, an independent stream is introduced to extract features from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Guangyu Ren , Yinxiao Yu , Hengyan Liu , Tania Stathaki

Knowledge distillation (KD), a technique widely employed in computer vision, has emerged as a de facto standard for improving the performance of small neural networks. However, prevailing KD-based approaches in video tasks primarily focus…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Guiqin Wang , Peng Zhao , Yanjiang Shi , Cong Zhao , Shusen Yang

Most of the top performing action recognition methods use optical flow as a "black box" input. Here we take a deeper look at the combination of flow and action recognition, and investigate why optical flow is helpful, what makes a flow…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Laura Sevilla-Lara , Yiyi Liao , Fatma Guney , Varun Jampani , Andreas Geiger , Michael J. Black

Unsupervised anomaly detection encompasses diverse applications in industrial settings where a high-throughput and precision is imperative. Early works were centered around one-class-one-model paradigm, which poses significant challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Sushovan Jena , Vishwas Saini , Ujjwal Shaw , Pavitra Jain , Abhay Singh Raihal , Anoushka Banerjee , Sharad Joshi , Ananth Ganesh , Arnav Bhavsar

Knowledge distillation (KD) represents a vital mechanism to transfer expertise from complex teacher networks to efficient student models. However, in decentralized or secure AI ecosystems, privacy regulations and proprietary interests often…

Machine Learning · Computer Science 2026-04-29 Tri-Nhan Vo , Dang Nguyen , Trung Le , Kien Do , Sunil Gupta

Learning from demonstrations in embodied control is often cast as behavioral cloning, and recent diffusion or flow-matching policies improve this paradigm by modeling multi-modal expert actions. Yet these methods remain offline supervised…

Machine Learning · Computer Science 2026-05-27 Zhenglin Wan , Jingxuan Wu , Xingrui Yu , Chubin Zhang , Mingcong Lei , Bo An , Ivor W. Tsang , Yang You

In this paper, we investigate the knowledge distillation (KD) strategy for object detection and propose an effective framework applicable to both homogeneous and heterogeneous student-teacher pairs. The conventional feature imitation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Lewei Yao , Renjie Pi , Hang Xu , Wei Zhang , Zhenguo Li , Tong Zhang

Compressed video action recognition classifies video samples by leveraging the different modalities in compressed videos, namely motion vectors, residuals, and intra-frames. For this purpose, three neural networks are deployed, each…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Efstathia Soufleri , Deepak Ravikumar , Kaushik Roy

In this study, we aim to predict the plausible future action steps given an observation of the past and study the task of instructional activity anticipation. Unlike previous anticipation tasks that aim at action label prediction, our work…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Zhengyuan Yang , Jingen Liu , Jing Huang , Xiaodong He , Tao Mei , Chenliang Xu , Jiebo Luo

The Contrastive Language-Image Pre-training (CLIP) has recently shown remarkable generalization on "zero-shot" training and has applied to many downstream tasks. We explore the adaptation of CLIP to achieve a more efficient and generalized…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Qiang Wang , Junlong Du , Ke Yan , Shouhong Ding

Human action recognition in dark videos is a challenging task for computer vision. Recent research focuses on applying dark enhancement methods to improve the visibility of the video. However, such video processing results in the loss of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Chi-Jui Chang , Oscar Tai-Yuan Chen , Vincent S. Tseng

Hybrid Optical Neural Networks (ONNs, typically consisting of an optical frontend and a digital backend) offer an energy-efficient alternative to fully digital deep networks for real-time, power-constrained systems. However, their adoption…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Jinlin Xiang , Minho Choi , Yubo Zhang , Zhihao Zhou , Arka Majumdar , Eli Shlizerman

The ability to understand the surrounding scene is of paramount importance for Autonomous Vehicles (AVs). This paper presents a system capable to work in an online fashion, giving an immediate response to the arise of anomalies surrounding…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Leonardo Rossi , Vittorio Bernuzzi , Tomaso Fontanini , Massimo Bertozzi , Andrea Prati

Object detection has achieved remarkable accuracy through deep learning, yet these improvements often come with increased computational cost, limiting deployment on resource-constrained devices. Knowledge Distillation (KD) provides an…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Mahdi Golizadeh , Nassibeh Golizadeh , Mohammad Ali Keyvanrad , Hossein Shirazi

Rectified flow and reflow procedures have significantly advanced fast generation by progressively straightening ordinary differential equation (ODE) flows. They operate under the assumption that image and noise pairs, known as couplings,…

Machine Learning · Computer Science 2024-11-04 Dogyun Park , Sojin Lee , Sihyeon Kim , Taehoon Lee , Youngjoon Hong , Hyunwoo J. Kim

Knowledge Distillation (KD) has been used in image classification for model compression. However, rare studies apply this technology on single-stage object detectors. Focal loss shows that the accumulated errors of easily-classified samples…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Shitao Tang , Litong Feng , Wenqi Shao , Zhanghui Kuang , Wei Zhang , Yimin Chen

Modern neural networks are powerful predictive models. However, when it comes to recognizing that they may be wrong about their predictions, they perform poorly. For example, for one of the most common activation functions, the ReLU and its…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Shervin Manzuri Shalmani , Fei Chiang , Rong Zheng