English
Related papers

Related papers: StereoISP: Rethinking Image Signal Processing for …

200 papers

Numerous low-level vision tasks operate in the RAW domain due to its linear properties, bit depth, and sensor designs. Despite this, RAW image datasets are scarce and more expensive to collect than the already large and public sRGB…

We introduce a deep learning approach to realistically edit an sRGB image's white balance. Cameras capture sensor images that are rendered by their integrated signal processor (ISP) to a standard RGB (sRGB) color space encoding. The ISP…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Mahmoud Afifi , Michael S. Brown

Multispectral (MS) images capture detailed scene information across a wide range of spectral bands, making them invaluable for applications requiring rich spectral data. Integrating MS imaging into multi camera devices, such as smartphones,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 SaiKiran Tedla , Junyong Lee , Beixuan Yang , Mahmoud Afifi , Michael S. Brown

Many flagship smartphone cameras now use a dedicated neural image signal processor (ISP) to render noisy raw sensor images to the final processed output. Training nightmode ISP networks relies on large-scale datasets of image pairs with:…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Abhijith Punnappurath , Abdullah Abuolaim , Abdelrahman Abdelhamed , Alex Levinshtein , Michael S. Brown

Inferring the 3D shape of an object from an RGB image has shown impressive results, however, existing methods rely primarily on recognizing the most similar 3D model from the training set to solve the problem. These methods suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Haozhe Xie , Hongxun Yao , Shangchen Zhou , Shengping Zhang , Xiaoshuai Sun , Wenxiu Sun

The deep learning (DL)-based methods of low-level tasks have many advantages over the traditional camera in terms of hardware prospects, error accumulation and imaging effects. Recently, the application of deep learning to replace the image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hongyang Chen , Kaisheng Ma

High dynamic range (HDR) imaging combines multiple images with different exposure times into a single high-quality image. The image signal processing pipeline (ISP) is a core component in digital cameras to perform these operations. It…

Image and Video Processing · Electrical Eng. & Systems 2021-10-05 Prashant Chaudhari , Franziska Schirrmacher , Andreas Maier , Christian Riess , Thomas Köhler

In order to deploy current computer vision (CV) models on resource-constrained low-power devices, recent works have proposed in-sensor and in-pixel computing approaches that try to partly/fully bypass the image signal processor (ISP) and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Gourav Datta , Zeyu Liu , Zihan Yin , Linyu Sun , Akhilesh R. Jaiswal , Peter A. Beerel

Multi-view image acquisition systems with two or more cameras can be rather costly due to the number of high resolution image sensors that are required. Recently, it has been shown that by covering a low resolution sensor with a non-regular…

Image and Video Processing · Electrical Eng. & Systems 2022-04-11 Markus Jonscher , Jürgen Seiler , Thomas Richter , Michel Bätz , André Kaup

Image Signal Processor (ISP) comprises of various blocks to reconstruct image sensor raw data to final image consumed by human visual system or computer vision applications. Each block typically has many tuning parameters due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Jun Nishimura , Timo Gerasimow , Sushma Rao , Aleksandar Sutic , Chyuan-Tyng Wu , Gilad Michael

Real-world imaging systems acquire measurements that are degraded by noise, optical aberrations, and other imperfections that make image processing for human viewing and higher-level perception tasks challenging. Conventional cameras…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Steven Diamond , Vincent Sitzmann , Frank Julca-Aguilar , Stephen Boyd , Gordon Wetzstein , Felix Heide

Images fed to a deep neural network have in general undergone several handcrafted image signal processing (ISP) operations, all of which have been optimized to produce visually pleasing images. In this work, we investigate the hypothesis…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 William Ljungbergh , Joakim Johnander , Christoffer Petersson , Michael Felsberg

Bistatic Integrated Sensing and Communication (ISAC) is poised to become a cornerstone technology in next-generation communication networks, such as Beyond 5G (B5G) and 6G, by enabling the concurrent execution of sensing and communication…

Signal Processing · Electrical Eng. & Systems 2025-07-15 Yi Wang , Keke Zu , Luping Xiang , Martin Haardt , Chaochao Wang , Xianchao Zhang , Kun Yang

In this work, we present a camera configuration for acquiring "stereoscopic dark flash" images: a simultaneous stereo pair in which one camera is a conventional RGB sensor, but the other camera is sensitive to near-infrared and…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Jian Wang , Tianfan Xue , Jonathan T. Barron , Jiawen Chen

Photometric stereo, a problem of recovering 3D surface normals using images of an object captured under different lightings, has been of great interest and importance in computer vision research. Despite the success of existing traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Ashish Tiwari , Shanmuganathan Raman

With the popularity of dual cameras in recently released smart phones, a growing number of super-resolution (SR) methods have been proposed to enhance the resolution of stereo image pairs. However, the lack of high-quality stereo datasets…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Yingqian Wang , Longguang Wang , Jungang Yang , Wei An , Yulan Guo

Deep learning-based ISP algorithms have demonstrated significant potential in raw2rgb reconstruction. However, existing networks have not fully considered the specific characteristics of raw data, such as black level and CFA, which can…

Image and Video Processing · Electrical Eng. & Systems 2024-06-18 Fei Li , Wenbo Hou , Peng Jia

Deep neural networks (DNNs) have recently become the leading method for low-light image enhancement (LLIE). However, despite significant progress, their outputs may still exhibit issues such as amplified noise, incorrect white balance, or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Zhihua Wang , Yu Long , Qinghua Lin , Kai Zhang , Yazhu Zhang , Yuming Fang , Li Liu , Xiaochun Cao

RGB-to-RAW reconstruction, or the reverse modeling of a camera Image Signal Processing (ISP) pipeline, aims to recover high-fidelity RAW data from RGB images. Despite notable progress, existing learning-based methods typically treat this…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Zhen Liu , Diedong Feng , Hai Jiang , Liaoyuan Zeng , Hao Wang , Chaoyu Feng , Lei Lei , Bing Zeng , Shuaicheng Liu

The reconstruction of a scene via a stereo-camera system is a two-steps process, where at first images from different cameras are matched to identify the set of point-to-point correspondences that then will actually be reconstructed in the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-15 Riccardo Beschi , Xiao Feng , Stefania Melillo , Leonardo Parisi , Lorena Postiglione