移动 NPU 上高效准确的量化图像超分辨率：Mobile AI & AIM 2022 挑战赛报告
图像与视频处理
2022-11-17 v1 计算机视觉与模式识别
摘要
图像超分辨率是移动和物联网设备上的常见任务，人们常常需要对低分辨率图像和视频帧进行放大和增强。尽管过去针对该问题已提出众多解决方案，但它们通常无法兼容具有诸多计算与内存限制的低功耗移动 NPU。在本 Mobile AI 挑战赛中，我们着手解决该问题，并提议参赛者设计一种高效的量化图像超分辨率方案，以在移动 NPU 上展现出实时性能。参赛者获得了 DIV2K 数据集，并训练了 INT8 模型以实现高质量的 3 倍图像放大。所有模型的推理时间在 Synaptics VS680 智能家居板上进行评估，该板搭载可加速量化神经网络的专用边缘 NPU。所有提出的方案均完全兼容上述 NPU，在重建全高清分辨率图像时展现出高达 60 FPS 的速率。本文提供了挑战赛中开发的所有模型的详细描述。
引用
@article{arxiv.2211.05910,
title = {Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 challenge: Report},
author = {Andrey Ignatov and Radu Timofte and Maurizio Denna and Abdel Younes and Ganzorig Gankhuyag and Jingang Huh and Myeong Kyun Kim and Kihwan Yoon and Hyeon-Cheol Moon and Seungho Lee and Yoonsik Choe and Jinwoo Jeong and Sungjei Kim and Maciej Smyl and Tomasz Latkowski and Pawel Kubik and Michal Sokolski and Yujie Ma and Jiahao Chao and Zhou Zhou and Hongfan Gao and Zhengfeng Yang and Zhenbing Zeng and Zhengyang Zhuge and Chenghua Li and Dan Zhu and Mengdi Sun and Ran Duan and Yan Gao and Lingshun Kong and Long Sun and Xiang Li and Xingdong Zhang and Jiawei Zhang and Yaqi Wu and Jinshan Pan and Gaocheng Yu and Jin Zhang and Feng Zhang and Zhe Ma and Hongbin Wang and Hojin Cho and Steve Kim and Huaen Li and Yanbo Ma and Ziwei Luo and Youwei Li and Lei Yu and Zhihong Wen and Qi Wu and Haoqiang Fan and Shuaicheng Liu and Lize Zhang and Zhikai Zong and Jeremy Kwon and Junxi Zhang and Mengyuan Li and Nianxiang Fu and Guanchen Ding and Han Zhu and Zhenzhong Chen and Gen Li and Yuanfan Zhang and Lei Sun and Dafeng Zhang and Neo Yang and Fitz Liu and Jerry Zhao and Mustafa Ayazoglu and Bahri Batuhan Bilecen and Shota Hirose and Kasidis Arunruangsirilert and Luo Ao and Ho Chun Leung and Andrew Wei and Jie Liu and Qiang Liu and Dahai Yu and Ao Li and Lei Luo and Ce Zhu and Seongmin Hong and Dongwon Park and Joonhee Lee and Byeong Hyun Lee and Seunggyu Lee and Se Young Chun and Ruiyuan He and Xuhao Jiang and Haihang Ruan and Xinjian Zhang and Jing Liu and Garas Gendy and Nabil Sabor and Jingchao Hou and Guanghui He},
journal= {arXiv preprint arXiv:2211.05910},
year = {2022}
}
备注
arXiv admin note: text overlap with arXiv:2105.07825, arXiv:2105.08826, arXiv:2211.04470, arXiv:2211.03885, arXiv:2211.05256