FFT-based Selection and Optimization of Statistics for Robust Recognition of Severely Corrupted Images
Abstract
Improving model robustness in case of corrupted images is among the key challenges to enable robust vision systems on smart devices, such as robotic agents. Particularly, robust test-time performance is imperative for most of the applications. This paper presents a novel approach to improve robustness of any classification model, especially on severely corrupted images. Our method (FROST) employs high-frequency features to detect input image corruption type, and select layer-wise feature normalization statistics. FROST provides the state-of-the-art results for different models and datasets, outperforming competitors on ImageNet-C by up to 37.1% relative gain, improving baseline of 40.9% mCE on severe corruptions.
Keywords
Cite
@article{arxiv.2403.14335,
title = {FFT-based Selection and Optimization of Statistics for Robust Recognition of Severely Corrupted Images},
author = {Elena Camuffo and Umberto Michieli and Jijoong Moon and Daehyun Kim and Mete Ozay},
journal= {arXiv preprint arXiv:2403.14335},
year = {2025}
}
Comments
ICASSP 2024. Copyright 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other