English
Related papers

Related papers: Bridging the Training-Deployment Gap: Gated Encodi…

200 papers

Convolutional neural networks require significant memory bandwidth and storage for intermediate computations, apart from substantial computing resources. Neural network quantization has significant benefits in reducing the amount of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Ron Banner , Yury Nahshan , Elad Hoffer , Daniel Soudry

Large-scale deep neural networks (DNNs) have achieved remarkable success in many application scenarios. However, high computational complexity and energy costs of modern DNNs make their deployment on edge devices challenging. Model…

Machine Learning · Computer Science 2024-04-29 Cédric Gernigon , Silviu-Ioan Filip , Olivier Sentieys , Clément Coggiola , Mickael Bruno

Existing image-to-image transformation approaches primarily focus on synthesizing visually pleasing data. Generating images with correct identity labels is challenging yet much less explored. It is even more challenging to deal with image…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Wei Xiong , Yutong He , Yixuan Zhang , Wenhan Luo , Lin Ma , Jiebo Luo

Automatic Perceptual Image Quality Assessment is a challenging problem that impacts billions of internet, and social media users daily. To advance research in this field, we propose a Mixture of Experts approach to train two separate…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Avinab Saha , Sandeep Mishra , Alan C. Bovik

Hybrid models that combine convolutional and transformer blocks offer strong performance in computer vision (CV) tasks but are resource-intensive for edge deployment. Although post-training quantization (PTQ) can help reduce resource…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Shaibal Saha , Lanyu Xu

Existing neural networks are memory-consuming and computationally intensive, making deploying them challenging in resource-constrained environments. However, there are various methods to improve their efficiency. Two such methods are…

Machine Learning · Computer Science 2023-11-10 Anastasiia Prutianova , Alexey Zaytsev , Chung-Kuei Lee , Fengyu Sun , Ivan Koryakovskiy

Segment Anything Models (SAMs), known for their exceptional zero-shot segmentation performance, have garnered significant attention in the research community. Nevertheless, their performance drops significantly on severely degraded,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Guangqian Guo , Aixi Ren , Yong Guo , Xuehui Yu , Jiacheng Tian , Wenli Li , Chaowei Wang , Yaoxing Wang , Shan Gao

The increasing demand for high image quality in mobile devices brings forth the need for better computational enhancement techniques, and image denoising in particular. At the same time, the images captured by these devices can be…

Computer Vision and Pattern Recognition · Computer Science 2017-03-01 Tal Remez , Or Litany , Raja Giryes , Alex M. Bronstein

Quantization-aware training (QAT) is a representative model compression method to reduce redundancy in weights and activations. However, most existing QAT methods require end-to-end training on the entire dataset, which suffers from long…

Machine Learning · Computer Science 2024-08-21 Xijie Huang , Zechun Liu , Shih-Yang Liu , Kwang-Ting Cheng

Low-light image enhancement (LLIE) aims to improve illumination while preserving high-quality color and texture. However, existing methods often fail to extract reliable feature representations due to severely degraded pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Xu Wu , Zhihui Lai , Xianxu Hou , Jie Zhou , Ya-nan Zhang , Linlin Shen

Latent generative models have emerged as a leading approach for high-quality image synthesis. These models rely on an autoencoder to compress images into a latent space, followed by a generative model to learn the latent distribution. We…

Machine Learning · Computer Science 2025-08-05 Theodoros Kouzelis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

The large language model and high-level vision model have achieved impressive performance improvements with large datasets and model sizes. However, low-level computer vision tasks, such as image dehaze and blur removal, still rely on a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Zheyan Jin , Shiqi Chen , Yueting Chen , Zhihai Xu , Huajun Feng

This article proposes and documents a machine-learning framework and tutorial for classifying images using mobile phones. Compared to computers, the performance of deep learning model performance degrades when deployed on a mobile phone and…

Image and Video Processing · Electrical Eng. & Systems 2022-06-02 Muhammad Muneeb , Samuel F. Feng , Andreas Henschel

Deep learning-based image compression (LIC) has achieved state-of-the-art rate-distortion (RD) performance, yet deploying these models on resource-constrained FPGAs remains a major challenge. This work presents a complete, multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiaxun Fang , Li Chen

Quantization-aware training (QAT) is widely adopted to quantize language models by training full-precision weights using gradients from the quantized model. The main bottleneck is its slow convergence and early performance plateau,…

Neural network quantization procedure is the necessary step for porting of neural networks to mobile devices. Quantization allows accelerating the inference, reducing memory consumption and model size. It can be performed without…

Machine Learning · Computer Science 2019-06-27 Alexander Goncharenko , Andrey Denisov , Sergey Alyamkin , Evgeny Terentev

Most recent methods of deep image enhancement can be generally classified into two types: decompose-and-enhance and illumination estimation-centric. The former is usually less efficient, and the latter is constrained by a strong assumption…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Xiaomeng Wu , Yongqing Sun , Akisato Kimura

Quantization-Aware Training (QAT) is a critical technique for deploying deep neural networks on resource-constrained devices. However, existing methods often face two major challenges: the highly non-uniform distribution of activations and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Shaohang Jia , Zhiyong Huang , Zhi Yu , Mingyang Hou , Shuai Miao , Han Yang

Recently, significant progress has been achieved in deep image matting. Most of the classical image matting methods are time-consuming and require an ideal trimap which is difficult to attain in practice. A high efficient image matting…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Yaoyi Li , Jianfu Zhang , Weijie Zhao , Hongtao Lu

As wireless communication systems advance toward Sixth Generation (6G) Radio Access Networks (RAN), Deep Learning (DL)-based neural receivers are emerging as transformative solutions for Physical Layer (PHY) processing, delivering superior…

Signal Processing · Electrical Eng. & Systems 2026-02-16 SaiKrishna Saketh Yellapragada , Esa Ollila , Mario Costa