English
Related papers

Related papers: Orthogonality of Diffractive Deep Neural Networks

200 papers

Recent years have seen a considerable surge of research on developing heuristic approaches to realize analog computing using physical waves. Among these, neuromorphic computing using light waves is envisioned to feature performance metrics…

Optics · Physics 2022-10-18 Cheng-Chia Tsai , Xiaoyan Huang , Zhicheng Wu , Zongfu Yu , Nanfang Yu

We numerically show that a deep neural network (DNN) can learn macroscopic thermodynamic laws purely from microscopic data. Using molecular dynamics simulations, we generate the data of snapshot images of gas particles undergoing adiabatic…

Statistical Mechanics · Physics 2025-11-21 Hiroto Kuroyanagi , Tatsuro Yuge

Deep neural networks (DNNs) have have shown state-of-the-art performance for computer vision applications like image classification, segmentation and object detection. Whereas recent advances have shown their vulnerability to manual digital…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Chengyin Hu , Weiwen Shi

Deep neural networks (DNNs) have achieved impressive performance on handling computer vision problems, however, it has been found that DNNs are vulnerable to adversarial examples. For such reason, adversarial perturbations have been…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Lin Wang , Wonjune Cho , Kuk-Jin Yoon

Physics-informed neural networks have emerged as a prominent new method for solving differential equations. While conceptually straightforward, they often suffer training difficulties that lead to relatively large discretization errors or…

Mathematical Physics · Physics 2024-03-13 Shivam Arora , Alex Bihlo , Francis Valiquette

Diffractive optical neural networks (DONNs), leveraging free-space light wave propagation for ultra-parallel, high-efficiency computing, have emerged as promising artificial intelligence (AI) accelerators. However, their inherent lack of…

Optics · Physics 2024-11-11 Ziang Yin , Yu Yao , Jeff Zhang , Jiaqi Gu

The widespread use of Deep Neural Networks (DNNs) has recently resulted in their application to challenging scientific visualization tasks. While advanced DNNs demonstrate impressive generalization abilities, understanding factors like…

Graphics · Computer Science 2024-08-13 Atul Kumar , Siddharth Garg , Soumya Dutta

Machine learning methods such as deep neural networks (DNNs), despite their success across different domains, are known to often generate incorrect predictions with high confidence on inputs outside their training distribution. The…

Machine Learning · Computer Science 2022-01-10 Ramneet Kaur , Susmit Jha , Anirban Roy , Sangdon Park , Edgar Dobriban , Oleg Sokolsky , Insup Lee

Recent studies have shown that deep neural networks (DNNs) perform significantly better than shallow networks and Gaussian mixture models (GMMs) on large vocabulary speech recognition tasks. In this paper, we argue that the improved…

Machine Learning · Computer Science 2018-12-06 Dong Yu , Michael L. Seltzer , Jinyu Li , Jui-Ting Huang , Frank Seide

Theoretical understanding of deep learning is one of the most important tasks facing the statistics and machine learning communities. While deep neural networks (DNNs) originated as engineering methods and models of biological networks in…

Machine Learning · Statistics 2018-06-04 Adam S. Charles

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that…

Numerical Analysis · Mathematics 2020-02-26 Kailai Xu , Eric Darve

Optical neural networks (ONNs) perform extensive computations using photons instead of electrons, resulting in passively energy-efficient and low-latency computing. Among various ONNs, the diffractive optical neural networks (DONNs)…

In this paper, we propose a phase shift deep neural network (PhaseDNN), which provides a uniform wideband convergence in approximating high frequency functions and solutions of wave equations. The PhaseDNN makes use of the fact that common…

Machine Learning · Computer Science 2019-12-17 Wei Cai , Xiaoguang Li , Lizuo Liu

Having the potential for high speed, high throughput, and low energy cost, optical neural networks (ONNs) have emerged as a promising candidate for accelerating deep learning tasks. In conventional ONNs, light amplitudes are modulated at…

Systems and Control · Electrical Eng. & Systems 2023-12-18 Ruidi Qiu , Amro Eldebiky , Grace Li Zhang , Xunzhao Yin , Cheng Zhuo , Ulf Schlichtmann , Bing Li

Optical computing has reemerged as a promising alternative computing paradigm for providing energy-efficient information processing in the age of artificial intelligence. Among various photonic neural network platforms, diffractive optical…

Optics · Physics 2025-02-18 Bahadır Utku Kesgin , Firdevs Yüce , Uğur Teğin

Recent advances in image data processing through machine learning and especially deep neural networks (DNNs) allow for new optimization and performance-enhancement schemes for radiation detectors and imaging hardware through data-endowed…

Instrumentation and Detectors · Physics 2024-02-23 S. Lin , S. Ning , H. Zhu , T. Zhou , C. L. Morris , S. Clayton , M. Cherukara , R. T. Chen , Z. Wang

Deep neural networks excel at finding hierarchical representations that solve complex tasks over large data sets. How can we humans understand these learned representations? In this work, we present network dissection, an analytic framework…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 David Bau , Jun-Yan Zhu , Hendrik Strobelt , Agata Lapedriza , Bolei Zhou , Antonio Torralba

This paper presents Discriminative Part Network (DP-Net), a deep architecture with strong interpretation capabilities, which exploits a pretrained Convolutional Neural Network (CNN) combined with a part-based recognition module. This system…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ronan Sicre , Hanwei Zhang , Julien Dejasmin , Chiheb Daaloul , Stéphane Ayache , Thierry Artières

Deep neural networks with applications from computer vision and image processing to medical diagnosis are commonly implemented using clock-based processors, where computation speed is limited by the clock frequency and the memory access…

Emerging Technologies · Computer Science 2022-07-06 Farshid Ashtiani , Alexander J. Geers , Firooz Aflatouni

The deep neural network (DNN) models for object detection using camera images are widely adopted in autonomous vehicles. However, DNN models are shown to be susceptible to adversarial image perturbations. In the existing methods of…

Robotics · Computer Science 2023-03-17 Hyung-Jin Yoon , Hamidreza Jafarnejadsani , Petros Voulgaris