English
Related papers

Related papers: Efficient Training for Optical Computing

200 papers

Optical aberrations of optical systems cause significant degradation of imaging quality. Aberration correction by sophisticated lens designs and special glass materials generally incurs high cost of manufacturing and the increase in the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Shuang Cui , Bingnan Wang , Quan Zheng

Optical machine learning offers advantages in terms of power efficiency, scalability and computation speed. Recently, an optical machine learning method based on Diffractive Deep Neural Networks (D2NNs) has been introduced to execute a…

Neural and Evolutionary Computing · Computer Science 2019-06-11 Deniz Mengu , Yi Luo , Yair Rivenson , Aydogan Ozcan

Optical processors, built with "optical neurons", can efficiently perform high-dimensional linear operations at the speed of light. Thus they are a promising avenue to accelerate large-scale linear computations. With the current advances in…

Unitary learning is a backpropagation that serves to unitary weights update in deep complex-valued neural network with full connections, meeting a physical unitary prior in diffractive deep neural network ([DN]2). However, the square matrix…

Optics · Physics 2021-11-03 Yong-Liang Xiao

Metaoptics are thin, planar surfaces consisting of many subwavelength optical resonators that can be designed to simultaneously control the amplitude, phase, and polarization to arbitrarily shape an optical wavefront much in the same manner…

Gratings and holograms are patterned surfaces that tailor optical signals by diffraction. Despite their long history, variants with remarkable functionalities continue to be discovered. Further advances could exploit Fourier optics, which…

Coherent photonic computing uses both the phase and amplitude of light to implement linear operations such as dot products and matrix multiplication but requires phase stability between the interfering paths. This poses a challenge for such…

Optics · Physics 2026-04-16 Shenghan Gao , Kathy Lüdge , Francesco Da Ros , Nathan Youngblood

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

Sparse training is a natural idea to accelerate the training speed of deep neural networks and save the memory usage, especially since large modern neural networks are significantly over-parameterized. However, most of the existing methods…

Machine Learning · Computer Science 2021-11-11 Xiao Zhou , Weizhong Zhang , Zonghao Chen , Shizhe Diao , Tong Zhang

Distributed learning is widely used for training large models on large datasets by distributing parts of the model or dataset across multiple devices and aggregating the computed results for subsequent computations or parameter updates.…

Machine Learning · Computer Science 2026-03-31 Sijie Fei , Grace Li Zhang , Bing Li , Ulf Schlichtmann

We present a novel learning-based method to build a differentiable computational model of a real fluorescence microscope. Our model can be used to calibrate a real optical setup directly from data samples and to engineer point spread…

Image and Video Processing · Electrical Eng. & Systems 2023-06-12 Josue Page , Paolo Favaro

End-to-end backpropagation requires storing activations throughout all layers, creating memory bottlenecks that limit model scalability. Existing block-wise training methods offer means to alleviate this problem, but they rely on ad-hoc…

Machine Learning · Computer Science 2026-02-19 Makoto Shing , Masanori Koyama , Takuya Akiba

Machine learning is attracting surging interest across nearly all scientific areas by enabling the analysis of large datasets and the extraction of scientific information from incomplete data. Data-driven science is rapidly growing,…

Applied Physics · Physics 2025-03-17 Sung Yun Lee , Do Hyung Cho , Chulho Jung , Daeho Sung , Daewoong Nam , Sangsoo Kim , Changyong Song

Optical logic gates are fundamental blocks of optical computing to accelerate information processing. While significant progress has been achieved in recent years, existing implementations typically rely on dedicated structures that are…

Optics · Physics 2022-08-30 Zhipeng Yu , Yuchen Song , Tianting Zhong , Huanhao Li , Wei Zheng , Puxiang Lai

Correcting the optical aberrations and the manufacturing deviations of cameras is a challenging task. Due to the limitation on volume and the demand for mass production, existing mobile terminals cannot rectify optical degradation. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Shiqi Chen , Ting Lin , Huajun Feng , Zhihai Xu , Qi Li , Yueting Chen

In many optical metrology techniques, fringe pattern analysis is the central algorithm for recovering the underlying phase distribution from the recorded fringe patterns. Despite extensive research efforts for decades, how to extract the…

Image and Video Processing · Electrical Eng. & Systems 2019-03-22 Shijie Feng , Qian Chen , Guohua Gu , Tianyang Tao , Liang Zhang , Yan Hu , Wei Yin , Chao Zuo

Diffractive deep neural networks (D2NNs), which perform computation using light instead of electrons, offer a promising pathway toward accelerating artificial intelligence by leveraging the inherent advantages of optics in speed,…

Optics · Physics 2025-07-24 Haoyu Wang , Yanmin Zhu , Tong Fu

Under spatially-coherent light, a diffractive optical network composed of structured surfaces can be designed to perform any arbitrary complex-valued linear transformation between its input and output fields-of-view (FOVs) if the total…

Optics · Physics 2023-08-17 Md Sadman Sakib Rahman , Xilin Yang , Jingxi Li , Bijie Bai , Aydogan Ozcan

Artificial neural networks have revolutionized fields from computer vision to natural language processing, yet their growing energy and computational demands threaten future progress. Optical neural networks promise greater speed,…

Optics · Physics 2025-08-18 Bofeng Liu , Xu Mei , Sadman Shafi , Tunan Xia , Iam-Choon Khoo , Zhiwen Liu , Xingjie Ni

Optimization in machine learning, both theoretical and applied, is presently dominated by first-order gradient methods such as stochastic gradient descent. Second-order optimization methods, that involve second derivatives and/or second…

Machine Learning · Computer Science 2021-03-08 Rohan Anil , Vineet Gupta , Tomer Koren , Kevin Regan , Yoram Singer