English
Related papers

Related papers: Low-Depth Optical Neural Networks

200 papers

Conventional integrated circuits (ICs) struggle to meet the escalating demands of artificial intelligence (AI). This has sparked a renewed interest in an unconventional computing paradigm: neuromorphic (brain-inspired) computing. However,…

Deep neural networks (DNNs) are state-of-the-art techniques for solving most computer vision problems. DNNs require billions of parameters and operations to achieve state-of-the-art results. This requirement makes DNNs extremely compute,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Ishmeet Kaur , Adwaita Janardhan Jadhav

Many real-world applications involve the use of Optical Character Recognition (OCR) engines to transform handwritten images into transcripts on which downstream Natural Language Processing (NLP) models are applied. In this process, OCR…

Computation and Language · Computer Science 2021-07-16 Guowei Xu , Wenbiao Ding , Weiping Fu , Zhongqin Wu , Zitao Liu

Artificial neural networks (ANNs), have become ubiquitous and revolutionized many applications ranging from computer vision to medical diagnoses. However, they offer a fundamentally connectionist and distributed approach to computing, in…

Large machine learning models based on Convolutional Neural Networks (CNNs) with rapidly increasing number of parameters, trained with massive amounts of data, are being deployed in a wide array of computer vision tasks from self-driving…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Rishab Parthasarathy , Rohan Bhowmik

Recently, optical neural networks (ONNs) integrated in photonic chips has received extensive attention because they are expected to implement the same pattern recognition tasks in the electronic platforms with high efficiency and low power…

Neural and Evolutionary Computing · Computer Science 2020-01-08 Tian Zhang , Jia Wang , Yihang Dan , Yuxiang Lanqiu , Jian Dai , Xu Han , Xiaojuan Sun , Kun Xu

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

Deep learning for distribution grid optimization can be advocated as a promising solution for near-optimal yet timely inverter dispatch. The principle is to train a deep neural network (DNN) to predict the solutions of an optimal power flow…

Optimization and Control · Mathematics 2020-07-09 Manish K. Singh , Sarthak Gupta , Vassilis Kekatos , Guido Cavraro , Andrey Bernstein

Optical artificial neural networks (ONNs), analog computing hardware tailored for machine learning, have significant potential for ultra-high computing speed and energy efficiency. We propose a new approach to architectures for ONNs based…

Optical neural networks (ONNs) perform extensive computations using photons instead of electrons, resulting in passively energy-efficient and low-latency computing. Among various ONNs, the diffractive optical neural networks (DONNs)…

Optimal Power Flow (OPF) is a fundamental problem in power systems. It is computationally challenging and a recent line of research has proposed the use of Deep Neural Networks (DNNs) to find OPF approximations at vastly reduced runtimes…

Machine Learning · Computer Science 2021-11-23 My H. Dinh , Ferdinando Fioretto , Mostafa Mohammadian , Kyri Baker

The computational demands of modern AI have spurred interest in optical neural networks (ONNs) which offer the potential benefits of increased speed and lower power consumption. However, current ONNs face various challenges,most…

Neural and Evolutionary Computing · Computer Science 2024-01-29 Xiansong Meng , Deming Kong , Kwangwoong Kim , Qiuchi Li , Po Dong , Ingemar J. Cox , Christina Lioma , Hao Hu

Deep Neural Networks (DNNs) are a revolutionary force in the ongoing information revolution, and yet their intrinsic properties remain a mystery. In particular, it is widely known that DNNs are highly sensitive to noise, whether adversarial…

Machine Learning · Computer Science 2020-05-01 Netanel Raviv , Siddharth Jain , Pulakesh Upadhyaya , Jehoshua Bruck , Anxiao Jiang

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

Diffractive optical neural networks (DONNs) have been emerging as a high-throughput and energy-efficient hardware platform to perform all-optical machine learning (ML) in machine vision systems. However, the current demonstrated…

Machine Learning · Computer Science 2023-02-23 Ruiyang Chen , Yingheng Tang , Jianzhu Ma , Weilu Gao

Deep Neural Networks (DNNs) are rapidly being applied to safety-critical domains such as drone and airplane control, motivating techniques for verifying the safety of their behavior. Unfortunately, DNN verification is NP-hard, with current…

Machine Learning · Computer Science 2020-09-15 Matthew Sotoudeh , Aditya V. Thakur

Optical neural network (ONN) has been attracting intense attention owing to their low latency and low-power consumption. Among the ONNs, optical recurrent neural network (RNN) enables low-power and high-speed time-series data processing…

A novel neural network (NN) approach is proposed for constrained optimization. The proposed method uses a specially designed NN architecture and training/optimization procedure called Neural Optimization Machine (NOM). The objective…

Machine Learning · Statistics 2022-08-10 Jie Chen , Yongming Liu

Deep Neural Networks (DNNs) have revolutionized a wide range of industries, from healthcare and finance to automotive, by offering unparalleled capabilities in data analysis and decision-making. Despite their transforming impact, DNNs face…

Machine Learning · Computer Science 2024-02-08 Zhenyu Liu , Garrett Gagnon , Swagath Venkataramani , Liu Liu

The current study uses a novel method of multilevel neurons and high order synchronization effects described by a family of special metrics, for pattern recognition in an oscillatory neural network (ONN). The output oscillator (neuron) of…

Emerging Technologies · Computer Science 2019-08-26 Andrei Velichko , Maksim Belyaev , Petr Boriskov