English
Related papers

Related papers: Learning with privileged information via adversari…

200 papers

We investigate whether knowledge distillation (KD) from multiple heterogeneous teacher models can enhance the generation of transferable adversarial examples. A lightweight student model is trained using two KD strategies: curriculum-based…

Machine Learning · Computer Science 2025-07-30 Siddhartha Pradhan , Shikshya Shiwakoti , Neha Bathuri

This paper addresses the problem of real-time action recognition in trimmed videos, for which deep neural networks have defined the state-of-the-art performance in the recent literature. For attaining higher recognition accuracies with…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Marian K. Y. Boktor , Ahmad Al-Kabbany , Radwa Khalil , Said El-Khamy

Knowledge distillation is normally used to compress a big network, or teacher, onto a smaller one, the student, by training it to match its outputs. Recently, some works have shown that robustness against adversarial attacks can also be…

Machine Learning · Computer Science 2022-03-15 Javier Maroto , Guillermo Ortiz-Jiménez , Pascal Frossard

Key challenges for the deployment of reinforcement learning (RL) agents in the real world are the discovery, representation and reuse of skills in the absence of a reward function. To this end, we propose a novel approach to learn a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Oier Mees , Markus Merklinger , Gabriel Kalweit , Wolfram Burgard

A challenge of skeleton-based action recognition is the difficulty to classify actions with similar motions and object-related actions. Visual clues from other streams help in that regard. RGB data are sensible to illumination conditions,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Alban Main de Boissiere , Rita Noumeir

Knowledge distillation has made remarkable achievements in model compression. However, most existing methods require the original training data, which is usually unavailable due to privacy and security issues. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Xinyi Yu , Ling Yan , Yang Yang , Libo Zhou , Linlin Ou

Monocular depth estimation from RGB images plays a pivotal role in 3D vision. However, its accuracy can deteriorate in challenging environments such as nighttime or adverse weather conditions. While long-wave infrared cameras offer stable…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Jialei Xu , Xianming Liu , Junjun Jiang , Kui Jiang , Rui Li , Kai Cheng , Xiangyang Ji

An important goal in deep learning is to learn versatile, high-level feature representations of input data. However, standard networks' representations seem to possess shortcomings that, as we illustrate, prevent them from fully realizing…

Machine Learning · Statistics 2019-09-30 Logan Engstrom , Andrew Ilyas , Shibani Santurkar , Dimitris Tsipras , Brandon Tran , Aleksander Madry

Resource-constrained perception systems such as edge computing and vision-for-robotics require vision models to be both accurate and lightweight in computation and memory usage. While knowledge distillation is a proven strategy to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Shengcao Cao , Mengtian Li , James Hays , Deva Ramanan , Yi-Xiong Wang , Liang-Yan Gui

In recent years, the rapid development of deep neural networks has brought increased attention to the security and robustness of these models. While existing adversarial attack algorithms have demonstrated success in improving adversarial…

Machine Learning · Computer Science 2025-02-25 Wenyuan Wu , Zheng Liu , Yong Chen , Chao Su , Dezhong Peng , Xu Wang

While deep neural networks have shown impressive performance in many tasks, they are fragile to carefully designed adversarial attacks. We propose a novel adversarial training-based model by Attention Guided Knowledge Distillation and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Hong Wang , Yuefan Deng , Shinjae Yoo , Haibin Ling , Yuewei Lin

This paper presents a novel method for detecting pedestrians under adverse illumination conditions. Our approach relies on a novel cross-modality learning framework and it is based on two main phases. First, given a multimodal dataset, a…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Dan Xu , Wanli Ouyang , Elisa Ricci , Xiaogang Wang , Nicu Sebe

Feature maps contain rich information about image intensity and spatial correlation. However, previous online knowledge distillation methods only utilize the class probabilities. Thus in this paper, we propose an online knowledge…

Machine Learning · Computer Science 2020-06-09 Inseop Chung , SeongUk Park , Jangho Kim , Nojun Kwak

In this paper, we propose a novel approach for learning multi-label classifiers with the help of privileged information. Specifically, we use similarity constraints to capture the relationship between available information and privileged…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Shiyu Chen , Shangfei Wang , Tanfang Chen , Xiaoxiao Shi

Object detection from RGB images is a long-standing problem in image processing and computer vision. It has applications in various domains including robotics, surveillance, human-computer interaction, and medical diagnosis. With the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Isaac Ronald Ward , Hamid Laga , Mohammed Bennamoun

Person re-identification is a key challenge for surveillance across multiple sensors. Prompted by the advent of powerful deep learning models for visual recognition, and inexpensive RGB-D cameras and sensor-rich mobile robotic platforms,…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Frank Hafner , Amran Bhuiyan , Julian F. P. Kooij , Eric Granger

Spatial and temporal stream model has gained great success in video action recognition. Most existing works pay more attention to designing effective features fusion methods, which train the two-stream model in a separate way. However, it's…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Jingran Zhang , Fumin Shen , Xing Xu , Heng Tao Shen

This paper addresses the issue on how to more effectively coordinate the depth with RGB aiming at boosting the performance of RGB-D object detection. Particularly, we investigate two primary ideas under the CNN model: property derivation…

Computer Vision and Pattern Recognition · Computer Science 2016-05-10 Saihui Hou , Zilei Wang , Feng Wu

There are two main issues in RGB-D salient object detection: (1) how to effectively integrate the complementarity from the cross-modal RGB-D data; (2) how to prevent the contamination effect from the unreliable depth map. In fact, these two…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Zuyao Chen , Runmin Cong , Qianqian Xu , Qingming Huang

In this paper, we tackle the problem of RGB-D semantic segmentation of indoor images. We take advantage of deconvolutional networks which can predict pixel-wise class labels, and develop a new structure for deconvolution of multiple…

Computer Vision and Pattern Recognition · Computer Science 2016-08-04 Jinghua Wang , Zhenhua Wang , Dacheng Tao , Simon See , Gang Wang