English
Related papers

Related papers: Snapshot Multispectral Imaging Using a Diffractive…

200 papers

We introduce an all-optical Diffractive Deep Neural Network (D2NN) architecture that can learn to implement various functions after deep learning-based design of passive diffractive layers that work collectively. We experimentally…

Neural and Evolutionary Computing · Computer Science 2018-09-26 Xing Lin , Yair Rivenson , Nezih T. Yardimci , Muhammed Veli , Mona Jarrahi , Aydogan Ozcan

Hyperspectral images (HSI) have become popular for analysing remotely sensed images in multiple domain like agriculture, medical. However, existing models struggle with complex relationships and characteristics of spectral-spatial data due…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Neetu Sigger , Tuan Thanh Nguyen , Gianluca Tozzi , Quoc-Tuan Vien , Sinh Van Nguyen

Permutation matrices form an important computational building block frequently used in various fields including e.g., communications, information security and data processing. Optical implementation of permutation operators with relatively…

Optics · Physics 2022-09-09 Deniz Mengu , Yifan Zhao , Anika Tabassum , Mona Jarrahi , Aydogan Ozcan

We propose an efficient inverse design approach for multifunctional optical elements based on adaptive deep diffractive neural networks (a-D$^2$NNs). Specifically, we introduce a-D$^2$NNs and design two-layer diffractive devices that can…

Optics · Physics 2022-06-08 Yuyao Chen , Yilin Zhu , Wesley A. Britton , Luca Dal Negro

Deep neural networks have proven to be very effective for computer vision tasks, such as image classification, object detection, and semantic segmentation -- these are primarily applied to color imagery and video. In recent years, there has…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Xiong Zhou , Saurabh Prasad

Traditional snapshot hyperspectral imaging systems generally require multiple refractive-optics-based elements to modulate light, resulting in bulky framework. In pursuit of a more compact form factor, a metasurface-based snapshot…

Optics · Physics 2022-11-29 Qiangbo Zhang , Zeqing Yu , Xinyu Liu , Chang Wang , Zhenrong Zheng

Recent research efforts in optical computing have gravitated towards developing optical neural networks that aim to benefit from the processing speed and parallelism of optics/photonics in machine learning applications. Among these…

Optics · Physics 2020-12-25 Deniz Mengu , Yair Rivenson , Aydogan Ozcan

Multispectral image fusion is a computer vision process that is essential to remote sensing. For applications such as dehazing and object detection, there is a need to offer solutions that can perform in real-time on any type of scene.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Nati Ofir , Jean-Christophe Nebel

Research on optical computing has recently attracted significant attention due to the transformative advances in machine learning. Among different approaches, diffractive optical networks composed of spatially-engineered transmissive…

Optics · Physics 2022-05-27 Jingxi Li , Yi-Chun Hung , Onur Kulce , Deniz Mengu , Aydogan Ozcan

Multispectral mid-infrared (2-5 ${{\mu}m}$) imaging is a critical capability across science and technology, offering a window into the vibrational and thermal landscape of matter that is inaccessible to visible sensors. It bridges the…

Optics · Physics 2026-01-29 Daniel Beitner , Ziv Abelson , Eyal Hollander , Omri Meron , Haim Suchowski

Spectro-polarimetric imaging provides multidimensional optical information acquisition capabilities, offering significant potential for diverse applications. Current spectro-polarimetric imaging systems typically suffer from large physical…

Image and Video Processing · Electrical Eng. & Systems 2025-09-18 Jingyue Ma , Zhenming Yu , Zhengyang Li , Liang Lin , Liming Cheng , Jiayu Di , Tongshuo Zhang , Ning Zhan , Kun Xu

Phase imaging is widely used in biomedical imaging, sensing, and material characterization, among other fields. However, direct imaging of phase objects with subwavelength resolution remains a challenge. Here, we demonstrate subwavelength…

We demonstrate a compact, cost-effective snapshot spectral imaging system named Aperture Diffraction Imaging Spectrometer (ADIS), which consists only of an imaging lens with an ultra-thin orthogonal aperture mask and a mosaic filter sensor,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Tao Lv , Hao Ye , Quan Yuan , Zhan Shi , Yibo Wang , Shuming Wang , Xun Cao

Transferring optical information through random diffusers is a critical yet challenging task. In this work, we introduce a cascaded diffractive optical network for information transfer through random and unknown diffusers, achieved through…

Optics · Physics 2026-03-10 Yuhang Li , Yiyang Wu , Shiqi Chen , Xilin Yang , Aydogan Ozcan

Encoding of spectral information onto monochrome imaging cameras is of interest for wavelength multiplexing and hyperspectral imaging applications. Here, the complex spatio-spectral response of a disordered material is used to demonstrate…

Optics · Physics 2017-05-09 Rebecca French , Sylvain Gigan , Otto L. Muskens

As an optical machine learning framework, Diffractive Deep Neural Networks (D2NN) take advantage of data-driven training methods used in deep learning to devise light-matter interaction in 3D for performing a desired statistical inference…

Image and Video Processing · Electrical Eng. & Systems 2020-07-08 Deniz Mengu , Yifan Zhao , Nezih T. Yardimci , Yair Rivenson , Mona Jarrahi , Aydogan Ozcan

Three-dimensional imaging plays an important role in imaging applications where it is necessary to record depth. The number of applications that use depth imaging is increasing rapidly, and examples include self-driving autonomous vehicles…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Alice Ruget , Stephen McLaughlin , Robert K. Henderson , Istvan Gyongy , Abderrahim Halimi , Jonathan Leach

Multi-spectral image stitching leverages the complementarity between infrared and visible images to generate a robust and reliable wide field-of-view (FOV) scene. The primary challenge of this task is to explore the relations between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zhiying Jiang , Zengxi Zhang , Jinyuan Liu , Xin Fan , Risheng Liu

Diffractive deep neural network (DNNet) is a novel machine learning framework on the modulation of optical transmission. Diffractive network would get predictions at the speed of light. It's pure passive architecture, no additional power…

Machine Learning · Computer Science 2019-12-24 Yingshi Chen , Jinfeng Zhu

Hyperspectral imaging has the potential to improve intraoperative decision making if tissue characterisation is performed in real-time and with high-resolution. Hyperspectral snapshot mosaic sensors offer a promising approach due to their…

Image and Video Processing · Electrical Eng. & Systems 2023-03-27 Peichao Li , Muhammad Asad , Conor Horgan , Oscar MacCormac , Jonathan Shapey , Tom Vercauteren