English
Related papers

Related papers: Distillation Improves Visual Place Recognition for…

200 papers

Unsupervised representation learning has proved to be a critical component of anomaly detection/localization in images. The challenges to learn such a representation are two-fold. Firstly, the sample size is not often large enough to learn…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Mohammadreza Salehi , Niousha Sadjadi , Soroosh Baselizadeh , Mohammad Hossein Rohban , Hamid R. Rabiee

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones. This…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Umberto Michieli , Pietro Zanuttigh

Deep learning networks have achieved state-of-the-art accuracies on computer vision workloads like image classification and object detection. The performant systems, however, typically involve big models with numerous parameters. Once…

Machine Learning · Computer Science 2017-11-17 Asit Mishra , Debbie Marr

End-to-end text spotting has attached great attention recently due to its benefits on global optimization and high maintainability for real applications. However, the input scale has always been a tough trade-off since recognizing a small…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Ying Chen , Liang Qiao , Zhanzhan Cheng , Shiliang Pu , Yi Niu , Xi Li

Knowledge distillation, a well-known model compression technique, is an active research area in both computer vision and remote sensing communities. In this paper, we evaluate in a remote sensing context various off-the-shelf object…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Hoàng-Ân Lê , Minh-Tan Pham

Diffusion-based models have been widely used in various visual generation tasks, showing promising results in image super-resolution (SR), while typically being limited by dozens or even hundreds of sampling steps. Although existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Xue Wu , Jingwei Xin , Zhijun Tu , Jie Hu , Jie Li , Nannan Wang , Xinbo Gao

Recent research has found that knowledge distillation can be effective in reducing the size of a network and in increasing generalization. A pre-trained, large teacher network, for example, was shown to be able to bootstrap a student model…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Hyun Seung Lee , Christian Wallraven

Knowledge distillation enhances the performance of compact student networks by transferring knowledge from more powerful teacher networks without introducing additional parameters. In the feature space, local regions within an individual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Cuipeng Wang , Haipeng Wang

Knowledge distillation from pretrained visual representation models offers an effective approach to improve small, task-specific production models. However, the effectiveness of such knowledge transfer drops significantly when distilling…

Machine Learning · Computer Science 2025-07-01 Chengyu Dong , Huan Gui , Noveen Sachdeva , Long Jin , Ke Yin , Jingbo Shang , Lichan Hong , Ed H. Chi , Zhe Zhao

Dataset distillation provides an effective approach to reduce memory and computational costs by optimizing a compact dataset that achieves performance comparable to the full original. However, for large-scale datasets and complex deep…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Zhaoyang Xu , Yaowei Wang , Min Zhang , Bin Chen

An important scenario for image quality assessment (IQA) is to evaluate image restoration (IR) algorithms. The state-of-the-art approaches adopt a full-reference paradigm that compares restored images with their corresponding…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Heliang Zheng , Huan Yang , Jianlong Fu , Zheng-Jun Zha , Jiebo Luo

Image inpainting methods have shown significant improvements by using deep neural networks recently. However, many of these techniques often create distorted structures or blurry textures inconsistent with surrounding areas. The problem is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Maitreya Suin , Kuldeep Purohit , A. N. Rajagopalan

Deep learning techniques have been demonstrated to surpass preceding cutting-edge machine learning techniques in recent years, with computer vision being one of the most prominent examples. However, deep learning models suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Gousia Habib , Tausifa jan Saleem , Sheikh Musa Kaleem , Tufail Rouf , Brejesh Lall

Metric learning networks are used to compute image embeddings, which are widely used in many applications such as image retrieval and face recognition. In this paper, we propose to use network distillation to efficiently compute image…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Lu Yu , Vacit Oguz Yazici , Xialei Liu , Joost van de Weijer , Yongmei Cheng , Arnau Ramisa

Recently, deep convolutional neural networks (CNNs) have been demonstrated remarkable progress on single image super-resolution. However, as the depth and width of the networks increase, CNN-based super-resolution methods have been faced…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Zheng Hui , Xiumei Wang , Xinbo Gao

Understanding visual relationships involves identifying the subject, the object, and a predicate relating them. We leverage the strong correlations between the predicate and the (subj,obj) pair (both semantically and spatially) to predict…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Ruichi Yu , Ang Li , Vlad I. Morariu , Larry S. Davis

Semantic correspondence, the task of determining relationships between different parts of images, underpins various applications including 3D reconstruction, image-to-image translation, object tracking, and visual place recognition. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Frank Fundel , Johannes Schusterbauer , Vincent Tao Hu , Björn Ommer

Visual place recognition (VPR) is the problem of recognising a previously visited location using visual information. Many attempts to improve the performance of VPR methods have been made in the literature. One approach that has received…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Maria Waheed , Michael Milford , Klaus D. McDonald-Maier , Shoaib Ehsan

Defocus Blur Detection(DBD) aims to separate in-focus and out-of-focus regions from a single image pixel-wisely. This task has been paid much attention since bokeh effects are widely used in digital cameras and smartphone photography.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Xiaodong Cun , Chi-Man Pun

Visual Place Recognition (VPR) is an image-based localization method that estimates the camera location of a query image by retrieving the most similar reference image from a map of geo-tagged reference images. In this work, we look into…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Mubariz Zaffar , Liangliang Nan , Julian Francisco Pieter Kooij