English
Related papers

Related papers: Learned Smartphone ISP on Mobile NPUs with Deep Le…

200 papers

Full DNN-based image signal processors (ISPs) have been actively studied and have achieved superior image quality compared to conventional ISPs. In contrast to this trend, we propose a lightweight ISP that consists of simple conventional…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Masakazu Yoshimura , Junji Otsuka , Takeshi Ohashi

As the revolutionary improvement being made on the performance of smartphones over the last decade, mobile photography becomes one of the most common practices among the majority of smartphone users. However, due to the limited size of…

Image and Video Processing · Electrical Eng. & Systems 2020-09-15 Linhui Dai , Xiaohong Liu , Chengqi Li , Jun Chen

Image signal processors (ISPs) are historically grown legacy software systems for reconstructing color images from noisy raw sensor measurements. Each smartphone manufacturer has developed its ISPs with its own characteristic heuristics for…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Matheus Souza , Wolfgang Heidrich

Video super-resolution is one of the most popular tasks on mobile devices, being widely used for an automatic improvement of low-bitrate and low-resolution video streams. While numerous solutions have been proposed for this problem, they…

The deep learning (DL)-based methods of low-level tasks have many advantages over the traditional camera in terms of hardware prospects, error accumulation and imaging effects. Recently, the application of deep learning to replace the image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hongyang Chen , Kaisheng Ma

Over the last years, the computational power of mobile devices such as smartphones and tablets has grown dramatically, reaching the level of desktop computers available not long ago. While standard smartphone apps are no longer a problem…

Artificial Intelligence · Computer Science 2018-10-16 Andrey Ignatov , Radu Timofte , William Chou , Ke Wang , Max Wu , Tim Hartley , Luc Van Gool

The increased importance of mobile photography created a need for fast and performant RAW image processing pipelines capable of producing good visual results in spite of the mobile camera sensor limitations. While deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Andrey Ignatov , Grigory Malivenko , Radu Timofte , Yu Tseng , Yu-Syuan Xu , Po-Hsiang Yu , Cheng-Ming Chiang , Hsien-Kai Kuo , Min-Hung Chen , Chia-Ming Cheng , Luc Van Gool

Convolutional neural networks (CNNs) are now predominant components in a variety of computer vision (CV) systems. These systems typically include an image signal processor (ISP), even though the ISP is traditionally designed to produce…

Image and Video Processing · Electrical Eng. & Systems 2021-03-18 Patrick Hansen , Alexey Vilkin , Yury Khrustalev , James Imber , David Hanwell , Matthew Mattina , Paul N. Whatmough

Image Signal Processors (ISPs) convert raw sensor signals into digital images, which significantly influence the image quality and the performance of downstream computer vision tasks. Designing ISP pipeline and tuning ISP parameters are two…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Yujin Wang , Tianyi Xu , Fan Zhang , Tianfan Xue , Jinwei Gu

Traditional image signal processing (ISP) pipeline consists of a set of individual image processing components onboard a camera to reconstruct a high-quality sRGB image from the sensor raw data. Due to the hand-crafted nature of the ISP…

Image and Video Processing · Electrical Eng. & Systems 2019-08-09 Zhetong Liang , Jianrui Cai , Zisheng Cao , Lei Zhang

Image signal processors (ISPs) are historically grown legacy software systems for reconstructing color images from noisy raw sensor measurements. They are usually composited of many heuristic blocks for denoising, demosaicking, and color…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Matheus Souza , Wolfgang Heidrich

The rise of mobile devices has spurred advancements in camera technology and image quality. However, mobile photography still faces issues like scattering and reflective flares. While previous research has acknowledged the negative impact…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Fengbo Lan , Chang Wen Chen

Smartphone cameras have gained immense popularity with the adoption of high-resolution and high-dynamic range imaging. As a result, high-performance camera Image Signal Processors (ISPs) are crucial in generating high-quality images for the…

This paper reviews the second AIM learned ISP challenge and provides the description of the proposed solutions and results. The participating teams were solving a real-world RAW-to-RGB mapping problem, where to goal was to map the original…

Cameras in modern devices such as smartphones, satellites and medical equipment are capable of capturing very high resolution images and videos. Such high-resolution data often need to be processed by deep learning models for cancer…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Arian Bakhtiarnia , Qi Zhang , Alexandros Iosifidis

Reconstructing RGB image from RAW data obtained with a mobile device is related to a number of image signal processing (ISP) tasks, such as demosaicing, denoising, etc. Deep neural networks have shown promising results over hand-crafted ISP…

Image and Video Processing · Electrical Eng. & Systems 2021-04-08 Byung-Hoon Kim , Joonyoung Song , Jong Chul Ye , JaeHyun Baek

This paper reviews the first challenge on efficient perceptual image enhancement with the focus on deploying deep learning models on smartphones. The challenge consisted of two tracks. In the first one, participants were solving the…

Image Signal Processor (ISP) is a crucial component in digital cameras that transforms sensor signals into images for us to perceive and understand. Existing ISP designs always adopt a fixed architecture, e.g., several sequential modules…

Image and Video Processing · Electrical Eng. & Systems 2021-09-13 Ke Yu , Zexian Li , Yue Peng , Chen Change Loy , Jinwei Gu

Digital cameras transform sensor RAW readings into RGB images by means of their Image Signal Processor (ISP). Computational photography tasks such as image denoising and colour constancy are commonly performed in the RAW domain, in part due…

Image and Video Processing · Electrical Eng. & Systems 2022-09-23 Marcos V. Conde , Steven McDonagh , Matteo Maggioni , Aleš Leonardis , Eduardo Pérez-Pellitero

Many flagship smartphone cameras now use a dedicated neural image signal processor (ISP) to render noisy raw sensor images to the final processed output. Training nightmode ISP networks relies on large-scale datasets of image pairs with:…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Abhijith Punnappurath , Abdullah Abuolaim , Abdelrahman Abdelhamed , Alex Levinshtein , Michael S. Brown