English
Related papers

Related papers: Analysis of Diffractive Neural Networks for Seeing…

200 papers

We report deep learning-based design of a massively parallel broadband diffractive neural network for all-optically performing a large group of arbitrarily-selected, complex-valued linear transformations between an input and output…

Neural and Evolutionary Computing · Computer Science 2023-01-10 Jingxi Li , Bijie Bai , Yi Luo , Aydogan Ozcan

Optical computing has reemerged as a promising alternative computing paradigm for providing energy-efficient information processing in the age of artificial intelligence. Among various photonic neural network platforms, diffractive optical…

Optics · Physics 2025-02-18 Bahadır Utku Kesgin , Firdevs Yüce , Uğur Teğin

Diffractive deep neural network (DNNet) is a novel machine learning framework on the modulation of optical transmission. Diffractive network would get predictions at the speed of light. It's pure passive architecture, no additional power…

Machine Learning · Computer Science 2019-12-24 Yingshi Chen , Jinfeng Zhu

Intense short-wavelength pulses from free-electron lasers and high-harmonic-generation sources enable diffractive imaging of individual nano-sized objects with a single x-ray laser shot. The enormous data sets with up to several million…

Representations learned by pre-training a neural network on a large dataset are increasingly used successfully to perform a variety of downstream tasks. In this work, we take a closer look at how features are encoded in such pre-trained…

Machine Learning · Computer Science 2023-11-15 Vedant Nanda , Till Speicher , John P. Dickerson , Soheil Feizi , Krishna P. Gummadi , Adrian Weller

Image restoration (IR) has been an indispensable and challenging task in the low-level vision field, which strives to improve the subjective quality of images distorted by various forms of degradation. Recently, the diffusion model has…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xin Li , Yulin Ren , Xin Jin , Cuiling Lan , Xingrui Wang , Wenjun Zeng , Xinchao Wang , Zhibo Chen

Diffusion models have shown remarkable performance on many generative tasks. Despite recent success, most diffusion models are restricted in that they only allow linear transformation of the data distribution. In contrast, broader family of…

Machine Learning · Computer Science 2024-06-04 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

We report the design of diffractive surfaces to all-optically perform arbitrary complex-valued linear transformations between an input (N_i) and output (N_o), where N_i and N_o represent the number of pixels at the input and output…

Optics · Physics 2021-09-27 Onur Kulce , Deniz Mengu , Yair Rivenson , Aydogan Ozcan

Research on optical computing has recently attracted significant attention due to the transformative advances in machine learning. Among different approaches, diffractive optical networks composed of spatially-engineered transmissive…

Optics · Physics 2022-05-27 Jingxi Li , Yi-Chun Hung , Onur Kulce , Deniz Mengu , Aydogan Ozcan

Denosing diffusion model, as a generative model, has received a lot of attention in the field of image generation recently, thanks to its powerful generation capability. However, diffusion models have not yet received sufficient research in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 ZiHan Cao , ShiQi Cao , Xiao Wu , JunMing Hou , Ran Ran , Liang-Jian Deng

Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep…

Optics · Physics 2023-04-07 Deniz Mengu , Anika Tabassum , Mona Jarrahi , Aydogan Ozcan

Precise engineering of materials and surfaces has been at the heart of some of the recent advances in optics and photonics. These advances around the engineering of materials with new functionalities have also opened up exciting avenues for…

Image and Video Processing · Electrical Eng. & Systems 2021-01-25 Onur Kulce , Deniz Mengu , Yair Rivenson , Aydogan Ozcan

We report a broadband diffractive optical neural network design that simultaneously processes a continuum of wavelengths generated by a temporally-incoherent broadband source to all-optically perform a specific task learned using deep…

Neural and Evolutionary Computing · Computer Science 2019-12-04 Yi Luo , Deniz Mengu , Nezih T. Yardimci , Yair Rivenson , Muhammed Veli , Mona Jarrahi , Aydogan Ozcan

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several studies have proposed…

Machine Learning · Computer Science 2024-05-30 Yifei Shen , Xinyang Jiang , Yezhen Wang , Yifan Yang , Dongqi Han , Dongsheng Li

Reasoning about 3D scenes from their 2D image projections is one of the core problems in computer vision. Solutions to this inverse and ill-posed problem typically involve a search for models that best explain observed image data. Notably,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Quentin Le Lidec , Ivan Laptev , Cordelia Schmid , Justin Carpentier

Building generalized models that can solve many computer vision tasks simultaneously is an intriguing direction. Recent works have shown image itself can be used as a natural interface for general-purpose visual perception and demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yue Fan , Yongqin Xian , Xiaohua Zhai , Alexander Kolesnikov , Muhammad Ferjad Naeem , Bernt Schiele , Federico Tombari

Generative diffusion models, famous for their performance in image generation, are popular in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling…

Networking and Internet Architecture · Computer Science 2025-03-11 Ruihuai Liang , Bo Yang , Zhiwen Yu , Bin Guo , Xuelin Cao , Mérouane Debbah , H. Vincent Poor , Chau Yuen

We propose a diffractive neural network with strong robustness based on Weight Noise Injection training, which achieves accurate and fast optical-based classification while diffraction layers have a certain amount of surface shape error. To…

Image and Video Processing · Electrical Eng. & Systems 2020-06-23 Jiashuo Shi

The problem of inpainting involves reconstructing the missing areas of an image. Inpainting has many applications, such as reconstructing old damaged photographs or removing obfuscations from images. In this paper we present the directional…

Computer Vision and Pattern Recognition · Computer Science 2015-11-12 Jan Deriu , Rolf Jagerman , Kai-En Tsay

Quantitative phase imaging (QPI) is a label-free computational imaging technique used in various fields, including biology and medical research. Modern QPI systems typically rely on digital processing using iterative algorithms for phase…

Optics · Physics 2023-06-28 Yuhang Li , Yi Luo , Deniz Mengu , Bijie Bai , Aydogan Ozcan