Related papers: Neural network-based on-chip spectroscopy using a …
Spectral imagers, the classic example being the color camera, are ubiquitous in everyday life. However, most such imagers rely on filter arrays that absorb light outside each spectral channel, yielding ~1/N efficiency for an N-channel…
Snapshot spectral imaging is rapidly gaining interest for remote sensing applications. Acquiring spatial and spectral data within one image promotes fast measurement times, and reduces the need for stabilized scanning imaging systems. Many…
Non-linear spectral decompositions of images based on one-homogeneous functionals such as total variation have gained considerable attention in the last few years. Due to their ability to extract spectral components corresponding to objects…
A typical 2D-to-3D pipeline takes multi-view images as input, where a Vision Foundation Model (VFM) extracts features that are spatially upsampled to dense representations for 3D reconstruction. If dense features across views preserve…
Multi-spectral imaging, which simultaneously captures the spatial and spectral information of a scene, is widely used across diverse fields, including remote sensing, biomedical imaging, and agricultural monitoring. Here, we introduce a…
In this work, we demonstrated on-chip label-free imaging microscopy using real and Fourier Plane (FP) microscopic dark field images of Surface Plasmons (SP), excited on engineered 1D and 2D low aspect ratio periodic plasmonic…
A lightweight and reproducible denoising pipeline for high-throughput Raman spectroscopy is presented. The approach relies on a one-dimensional convolutional autoencoder trained using a Noise2Noise strategy, requiring neither external…
Depth estimation is an important computer vision task, useful in particular for navigation in autonomous vehicles, or for object manipulation in robotics. Here we solved it using an end-to-end neuromorphic approach, combining two…
Learning-based single image super-resolution (SISR) methods are continuously showing superior effectiveness and efficiency over traditional model-based methods, largely due to the end-to-end training. However, different from model-based…
This work introduces a highly scalable spectral graph densification framework for learning resistor networks with linear measurements, such as node voltages and currents. We prove that given $O(\log N)$ pairs of voltage and current…
Existing methods for spectral reconstruction usually learn a discrete mapping from RGB images to a number of spectral bands. However, this modeling strategy ignores the continuous nature of spectral signature. In this paper, we propose…
We demonstrate chip-scale sub-Doppler spectroscopy in an integrated and fiber-coupled photonic-metasurface device. The device is a stack of three planar components: a photonic mode expanding grating emitter circuit with a monolithically…
The increasing complexity of neural networks and the energy consumption associated with training and inference create a need for alternative neuromorphic approaches, e.g. using optics. Current proposals and implementations rely on physical…
Inverse-designed nanophotonic devices offer promising solutions for analog optical computation. High-density photonic integration is critical for scaling such architectures toward more complex computational tasks and large-scale…
Spectral complexity is a useful resource in physical device identification, disorder-enhanced spectroscopy, and machine learning, but is often achieved in chip-scale devices at the expense of propagation loss, scalability, or…
We present Neural Spectral Methods, a technique to solve parametric Partial Differential Equations (PDEs), grounded in classical spectral methods. Our method uses orthogonal bases to learn PDE solutions as mappings between spectral…
Infrared spectroscopy is the technique of choice for chemical identification of biomolecules through their vibrational fingerprints. However, infrared light interacts poorly with nanometric size molecules. Here, we exploit the unique…
We configure and analyze a nanostructured device that hybridizes grating modes and surface plasmon resonances. The model uses an effective index of refraction that considers the volume fraction of the involved materials, and the propagation…
In medical imaging, scans often reveal objects with varied contrasts but consistent internal intensities or textures. This characteristic enables the use of low-frequency approximations for tasks such as segmentation and deformation field…
We consider the problem of active 3D imaging using single-shot structured light systems, which are widely employed in commercial 3D sensing devices such as Apple Face ID and Intel RealSense. Traditional structured light methods typically…