English
Related papers

Related papers: Enabling ISP-less Low-Power Computer Vision

200 papers

High-quality photography in extreme low-light conditions is challenging but impactful for digital cameras. With advanced computing hardware, traditional camera image signal processor (ISP) algorithms are gradually being replaced by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Amber Yijia Zheng , Yu Zhang , Jun Hu , Raymond A. Yeh , Chen Chen

Conventional image signal processing (ISP) frameworks are designed to reconstruct an RGB image from a single raw measurement. As multi-camera systems become increasingly popular these days, it is worth exploring improvements in ISP…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Ahmad Bin Rabiah , Qi Guo

Under-display cameras have been proposed in recent years as a way to reduce the form factor of mobile devices while maximizing the screen area. Unfortunately, placing the camera behind the screen results in significant image distortions,…

Image and Video Processing · Electrical Eng. & Systems 2021-11-03 Miao Qi , Yuqi Li , Wolfgang Heidrich

Due to the high activation sparsity and use of accumulates (AC) instead of expensive multiply-and-accumulates (MAC), neuromorphic spiking neural networks (SNNs) have emerged as a promising low-power alternative to traditional DNNs for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Gourav Datta , Zeyu Liu , Md Abdullah-Al Kaiser , Souvik Kundu , Joe Mathai , Zihan Yin , Ajey P. Jacob , Akhilesh R. Jaiswal , Peter A. Beerel

In smartphones and compact cameras, the Image Signal Processor (ISP) transforms the RAW sensor image into a human-readable sRGB image. Most popular super-resolution methods depart from a sRGB image and upscale it further, improving its…

Image and Video Processing · Electrical Eng. & Systems 2023-12-27 Marcos V. Conde , Florin Vasluianu , Radu Timofte

Deep neural networks (DNNs) have recently become the leading method for low-light image enhancement (LLIE). However, despite significant progress, their outputs may still exhibit issues such as amplified noise, incorrect white balance, or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Zhihua Wang , Yu Long , Qinghua Lin , Kai Zhang , Yazhu Zhang , Yuming Fang , Li Liu , Xiaochun Cao

Unprocessed RAW data is a highly valuable image format for image editing and computer vision. However, since the file size of RAW data is huge, most users can only get access to processed and compressed sRGB images. To bridge this gap, we…

Image and Video Processing · Electrical Eng. & Systems 2021-04-07 Yazhou Xing , Zian Qian , Qifeng Chen

Traditional image signal processors (ISPs) are primarily designed and optimized to improve the image quality perceived by humans. However, optimal perceptual image quality does not always translate into optimal performance for computer…

Image and Video Processing · Electrical Eng. & Systems 2019-11-15 Chyuan-Tyng Wu , Leo F. Isikdogan , Sushma Rao , Bhavin Nayak , Timo Gerasimow , Aleksandar Sutic , Liron Ain-kedem , Gilad Michael

Traditional image signal processing (ISP) pipeline consists of a set of individual image processing components onboard a camera to reconstruct a high-quality sRGB image from the sensor raw data. Due to the hand-crafted nature of the ISP…

Image and Video Processing · Electrical Eng. & Systems 2019-08-09 Zhetong Liang , Jianrui Cai , Zisheng Cao , Lei Zhang

Multiple low-vision tasks such as denoising, deblurring and super-resolution depart from RGB images and further reduce the degradations, improving the quality. However, modeling the degradations in the sRGB domain is complicated because of…

Image and Video Processing · Electrical Eng. & Systems 2024-09-30 Marcos V. Conde , Florin Vasluianu , Radu Timofte

The entire Image Signal Processor (ISP) of a camera relies on several processes to transform the data from the Color Filter Array (CFA) sensor, such as demosaicing, denoising, and enhancement. These processes can be executed either by some…

The availability of large-scale datasets has helped unleash the true potential of deep convolutional neural networks (CNNs). However, for the single-image denoising problem, capturing a real dataset is an unacceptably expensive and…

Image and Video Processing · Electrical Eng. & Systems 2020-03-18 Syed Waqas Zamir , Aditya Arora , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang , Ling Shao

In modern smartphone cameras, the Image Signal Processor (ISP) is the core element that converts the RAW readings from the sensor into perceptually pleasant RGB images for the end users. The ISP is typically proprietary and handcrafted and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Omar Elezabi , Marcos V. Conde , Radu Timofte

RGB-to-RAW reconstruction, or the reverse modeling of a camera Image Signal Processing (ISP) pipeline, aims to recover high-fidelity RAW data from RGB images. Despite notable progress, existing learning-based methods typically treat this…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Zhen Liu , Diedong Feng , Hai Jiang , Liaoyuan Zeng , Hao Wang , Chaoyu Feng , Lei Lei , Bing Zeng , Shuaicheng Liu

Reconstructing RGB image from RAW data obtained with a mobile device is related to a number of image signal processing (ISP) tasks, such as demosaicing, denoising, etc. Deep neural networks have shown promising results over hand-crafted ISP…

Image and Video Processing · Electrical Eng. & Systems 2021-04-08 Byung-Hoon Kim , Joonyoung Song , Jong Chul Ye , JaeHyun Baek

We propose a trainable Image Signal Processing (ISP) framework that produces DSLR quality images given RAW images captured by a smartphone. To address the color misalignments between training image pairs, we employ a color-conditional ISP…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ardhendu Shekhar Tripathi , Martin Danelljan , Samarth Shukla , Radu Timofte , Luc Van Gool

sRGB images are now the predominant choice for pre-training visual models in computer vision research, owing to their ease of acquisition and efficient storage. Meanwhile, the advantage of RAW images lies in their rich physical information…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Ziteng Cui , Tatsuya Harada

Implicit Neural Representations (INRs) encoding continuous multi-media data via multi-layer perceptrons has shown undebatable promise in various computer vision tasks. Despite many successful applications, editing and processing an INR…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Dejia Xu , Peihao Wang , Yifan Jiang , Zhiwen Fan , Zhangyang Wang

Edge-based computer vision models running on compact, resource-limited devices benefit greatly from using unprocessed, detail-rich RAW sensor data instead of processed RGB images. Training these models, however, necessitates large labeled…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Radu Berdan , Beril Besbinar , Christoph Reinders , Junji Otsuka , Daisuke Iso

Adversarial attacks play an essential role in understanding deep neural network predictions and improving their robustness. Existing attack methods aim to deceive convolutional neural network (CNN)-based classifiers by manipulating RGB…

Computer Vision and Pattern Recognition · Computer Science 2021-02-22 Buu Phan , Fahim Mannan , Felix Heide