English
Related papers

Related papers: QuATON: Quantization Aware Training of Optical Neu…

200 papers

We introduce a method to train Quantized Neural Networks (QNNs) --- neural networks with extremely low precision (e.g., 1-bit) weights and activations, at run-time. At train-time the quantized weights and activations are used for computing…

Neural and Evolutionary Computing · Computer Science 2016-09-23 Itay Hubara , Matthieu Courbariaux , Daniel Soudry , Ran El-Yaniv , Yoshua Bengio

Linear optics quantum computing (LOQC) is a leading candidate for the implementation of large scale quantum computers. Here quantum information is encoded into the quantum states of light and computation proceeds via a linear optics…

Quantum Physics · Physics 2012-11-21 Peter P. Rohde

Computational hardware designed to mimic biological neural networks holds the promise to resolve the drastically growing global energy demand of artificial intelligence. A wide variety of hardware concepts have been proposed, and among…

We introduce a quantization-aware training algorithm that guarantees avoiding numerical overflow when reducing the precision of accumulators during inference. We leverage weight normalization as a means of constraining parameters during…

Machine Learning · Computer Science 2023-02-01 Ian Colbert , Alessandro Pappalardo , Jakoba Petri-Koenig

There has been a resurgence of interest in optical computing over the past decade, both in academia and in industry, with much of the excitement centered around special-purpose optical computers for neural-network processing. Optical…

Optics · Physics 2023-10-10 Peter L. McMahon

Deep neural networks (DNNs) have substantial computational requirements, which greatly limit their performance in resource-constrained environments. Recently, there are increasing efforts on optical neural networks and optical computing…

Machine Learning · Computer Science 2021-04-05 Yingjie Li , Ruiyang Chen , Berardi Sensale Rodriguez , Weilu Gao , Cunxi Yu

Hyperparameters and learning algorithms for neuromorphic hardware are usually chosen by hand. In contrast, the hyperparameters and learning algorithms of networks of neurons in the brain, which they aim to emulate, have been optimized…

Neural and Evolutionary Computing · Computer Science 2019-06-11 Thomas Bohnstingl , Franz Scherr , Christian Pehle , Karlheinz Meier , Wolfgang Maass

Machine learning methods have nowadays become easy-to-use tools for constructing high-dimensional interatomic potentials with ab initio accuracy. Although machine learned interatomic potentials are generally orders of magnitude faster than…

Computational Physics · Physics 2021-02-24 Yaolong Zhang , Ce Hu , Bin Jiang

Deep learning as a means to inferencing has proliferated thanks to its versatility and ability to approach or exceed human-level accuracy. These computational models have seemingly insatiable appetites for computational resources not only…

Optical computing has reemerged as a promising alternative computing paradigm for providing energy-efficient information processing in the age of artificial intelligence. Among various photonic neural network platforms, diffractive optical…

Optics · Physics 2025-02-18 Bahadır Utku Kesgin , Firdevs Yüce , Uğur Teğin

We discuss a new direction in the field of quantum information processing with neutral atoms. It is based on the use of microfabricated optical elements. With these elements versatile and integrated atom optical devices can be created in a…

Quantum Physics · Physics 2007-05-23 F. B. J. Buchkremer , R. Dumke , M. Volk , T. Muether , G. Birkl , W. Ertmer

Diffractive neural network (DNN), which can perform machine learning tasks based on the light propagation and diffraction, has recently emerged as a promising optical computing paradigm due to its high parallel processing speed and low…

Optics · Physics 2026-01-27 Yudong Tian , Haifeng Xu , Yuqing Liu , Xiangyu Zhao , Jierong Cheng , Chongzhao Wu

Artificial neural networks have been proposed as potential algorithms that could benefit from being implemented and run on quantum computers. In particular, they hold promise to greatly enhance Artificial Intelligence tasks, such as image…

Quantum Physics · Physics 2021-03-04 Stefano Mangini , Francesco Tacchino , Dario Gerace , Chiara Macchiavello , Daniele Bajoni

Deep neural networks are the state-of-the-art methods for many real-world tasks, such as computer vision, natural language processing and speech recognition. For all its popularity, deep neural networks are also criticized for consuming a…

Machine Learning · Computer Science 2018-12-18 Yunhui Guo

Deploying deep neural networks on resource-constrained 6G edge devices demands aggressive compression with minimal accuracy loss. Quantization-Aware Training (QAT) has emerged as a leading compression approach; however, existing…

While neural networks have advanced the frontiers in many applications, they often come at a high computational cost. Reducing the power and latency of neural network inference is key if we want to integrate modern networks into edge…

Machine Learning · Computer Science 2021-06-16 Markus Nagel , Marios Fournarakis , Rana Ali Amjad , Yelysei Bondarenko , Mart van Baalen , Tijmen Blankevoort

For the past two decades, researchers have attempted to create a Quantum Neural Network (QNN) by combining the merits of quantum computing and neural computing. In order to exploit the advantages of the two prolific fields, the QNN must…

Quantum Physics · Physics 2015-12-15 Kok-Leong Seow , Elizabeth Behrman , James Steck

Optical computing chips have emerged as a transformative computing technology due to their high computational density, low energy consumption, and compact footprint. While real- and complex-valued computing chips have been well developed,…

Optics · Physics 2026-01-06 Songyue Liu , Qi Lu , Yuan Zhong , Yuru Li , Meng Xiang , Zhaohui Li , Chao Lu , Yikai Su , Lu Sun

In light of recent achievements in optical computing and machine learning, we consider the conditions under which all-optical computing may surpass electronic and optoelectronic computing in terms of energy efficiency and scalability. When…

Emerging Technologies · Computer Science 2023-06-14 Michał Matuszewski , Adam Prystupiuk , Andrzej Opala

The use of advanced quantum neuron models for pattern recognition applications requires fault tolerance. Therefore, it is not yet possible to test such models on a large scale in currently available quantum processors. As an alternative, we…

Quantum Physics · Physics 2022-02-18 London A. Cavaletto , Luca Candelori , Alex Matos-Abiague