Related papers: Bayer-type Vis-NIR Routing via Inverse Design for …
It has long been a challenging task to improve the light collection efficiency of conventional image sensors built with color filters that inevitably cause the energy loss of out-of-band photons. Although various schemes have been proposed…
Pixel scaling effects have been a major issue for the development of high-resolution color image sensors due to the reduced photoelectric signal and the color crosstalk. Various structural color techniques have been proposed and…
The out-of-band energy loss caused by in-built color filters significantly degrades the signal-to-noise ratio and the dynamic range of conventional image sensors, which has restricted the attempt to develop ultrahigh-density imaging devices…
Digital color imaging relies on spectral filters on top of a pixelated sensor, such as a CMOS image sensor. An important parameter of imaging devices is their resolution, which depends on the size of the pixels. For many applications, a…
Inverse rendering aims to reconstruct geometry and reflectance of objects from images. Despite recent progress, existing methods often produces inaccurate reconstructions that are sensitive to ambient illumination conditions. Here we…
We propose a new approach for image compression in digital cameras, where the goal is to achieve better quality at a given rate by using the characteristics of a Bayer color filter array. Most digital cameras produce color images by using a…
Modern digital cameras and smartphones mostly rely on image signal processing (ISP) pipelines to produce realistic colored RGB images. However, compared to DSLR cameras, low-quality images are usually obtained in many portable mobile…
In this paper, we propose a method to add constraints that are un-formulatable in generative adversarial networks (GAN)-based arbitrary size RAW Bayer image generation. It is shown theoretically that by using the transformed data in GAN…
Narrowband perfect absorbers are interesting for spectrum sensing, molecular detection, and infrared imaging. However, their design remains constrained by intuitive, iterative methods that lack flexibility, while also facing challenges in…
This paper proposes a method for transferring the RGB color spectrum to near-infrared (NIR) images using deep multi-scale convolutional neural networks. A direct and integrated transfer between NIR and RGB pixels is trained. The trained…
The method of a linear high dynamic range imaging using solid-state photosensors with Bayer colour filters array is provided in this paper. Using information from neighbour pixels, it is possible to reconstruct linear images with wide…
Recent progress on many imaging and vision tasks has been driven by the use of deep feed-forward neural networks, which are trained by propagating gradients of a loss defined on the final output, back through the network up to the first…
Integrated photonic biosensors provide compact, highly sensitive, and label-free platforms for biochemical detection, making them attractive for on-chip and real-time sensing applications. However, their design remains challenging due to…
Modern microelectronic processors have migrated towards parallel computing architectures with many-core processors. However, such expansion comes with diminishing returns exacted by the high cost of data movement between individual…
Nanophotonics has emerged as a powerful tool for manipulating light on chips. Almost all of today's devices, however, have been designed using slow and ineffective brute-force search methods, leading in many cases to limited device…
Hyperspectral imaging provides high-dimensional spatial-temporal-spectral information revealing intrinsic matter characteristics. Here we report an on-chip computational hyperspectral imaging framework with high spatial and temporal…
High-resolution digital images are usually downscaled to fit various display screens or save the cost of storage and bandwidth, meanwhile the post-upscaling is adpoted to recover the original resolutions or the details in the zoom-in…
With the advancement of computing resources, an increasing number of Neural Networks (NNs) are appearing for image detection and segmentation appear. However, these methods usually accept as input a RGB 2D image. On the other side, Light…
Fourier ptychography is a recently explored imaging method for overcoming the diffraction limit of conventional cameras with applications in microscopy and yielding high-resolution images. In order to splice together low-resolution images…
Deep learning (DL) has revolutionized many fields such as materials design and protein folding. Recent studies have demonstrated the advantages of DL in the inverse design of structural colors, by effectively learning the complex nonlinear…