English
Related papers

Related papers: SupeRBNN: Randomized Binary Neural Network Using A…

200 papers

Adiabatic quantum-flux-parametron (AQFP) logic is an energy-efficient superconductor logic. It operates with zero static power dissipation and very low dynamic power dissipation owing to adiabatic switching. In previous numerical studies,…

Emerging Technologies · Computer Science 2019-10-29 Taiki Yamae , Naoki Takeuchi , Nobuyuki Yoshikawa

Attention-based neural networks have become pervasive in many AI tasks. Despite their excellent algorithmic performance, the use of the attention mechanism and feed-forward network (FFN) demands excessive computational and memory resources,…

Spiking neural networks (SNNs) have shown advantages in computation and energy efficiency over traditional artificial neural networks (ANNs) thanks to their event-driven representations. SNNs also replace weight multiplications in ANNs with…

Neural and Evolutionary Computing · Computer Science 2023-06-01 Yangfan Hu , Qian Zheng , Xudong Jiang , Gang Pan

This paper proposes ReBNet, an end-to-end framework for training reconfigurable binary neural networks on software and developing efficient accelerators for execution on FPGA. Binary neural networks offer an intriguing opportunity for…

Machine Learning · Computer Science 2018-03-29 Mohammad Ghasemzadeh , Mohammad Samragh , Farinaz Koushanfar

Analog mixed-signal (AMS) devices promise faster, more energy-efficient deep neural network (DNN) inference than their digital counterparts. However, recent studies show that DNNs on AMS devices with fixed-point numbers can incur an…

Neural networks (NNs) have demonstrated their potential in a wide range of applications such as image recognition, decision making or recommendation systems. However, standard NNs are unable to capture their model uncertainty which is…

Hardware Architecture · Computer Science 2021-12-02 Hongxiang Fan , Martin Ferianc , Miguel Rodrigues , Hongyu Zhou , Xinyu Niu , Wayne Luk

We consider adiabatic superconducting cells operating as an artificial neuron and synapse of a multilayer perceptron (MLP). Their compact circuits contain just one and two Josephson junctions, respectively. While the signal is represented…

Spiking Neural Networks (SNNs) exhibit exceptional energy efficiency on neuromorphic hardware due to their sparse activation patterns. However, conventional training methods based on surrogate gradients and Backpropagation Through Time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Xiaochen Zhao , Chengting Yu , Kairong Yu , Lei Liu , Aili Wang

The training of neural networks (NNs) is a computationally intensive task requiring significant time and resources. This paper presents a novel approach to NN training using Adiabatic Quantum Computing (AQC), a paradigm that leverages the…

Quantum Physics · Physics 2023-08-28 Steve Abel , Juan Carlos Criado , Michael Spannowsky

Running Deep Neural Network (DNN) models on devices with limited computational capability is a challenge due to large compute and memory requirements. Quantized Neural Networks (QNNs) have emerged as a potential solution to this problem,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Yaman Umuroglu , Magnus Jahre

Binary convolutional neural networks (BCNNs) provide a potential solution to reduce the memory requirements and computational costs associated with deep neural networks (DNNs). However, achieving a trade-off between performance and…

Machine Learning · Computer Science 2024-05-15 Po-Hsun Chu , Ching-Han Chen

We propose Alternating Phase-Field Fourier Neural Networks (APF-FNNs) as a unified and physics-based framework for topology optimization. The approach decouples the design problem by representing the state, adjoint, and topology fields with…

Optimization and Control · Mathematics 2026-01-27 Jing Li , Xindi Hu , Helin Gong , Wei Gong , Shengfeng Zhu

Transportation systems such as urban logistics, vehicle routing, and infrastructure planning require solving large-scale combinatorial optimization problems under complex constraints. Problems such as the vehicle routing problem (VRP),…

Quantum Physics · Physics 2026-04-30 Talha Azfar , Ruimin Ke , Sean He , Cara Wang , José Holguín-Veras

With the rising societal demand for more information-processing capacity with lower power consumption, alternative architectures inspired by the parallelism and robustness of the human brain have recently emerged as possible solutions. In…

Neurons and Cognition · Quantitative Biology 2019-07-02 Emily Toomey , Ken Segall , Karl K. Berggren

A scalable superconducting architecture for adiabatic quantum computers is proposed. The architecture is based on time-independent, nearest-neighbor interqubit couplings: it can handle any problem in the class NP even in the presence of…

Quantum Physics · Physics 2007-05-23 William M. Kaminsky , Seth Lloyd , Terry P. Orlando

Domain specific neural network accelerators have garnered attention because of their improved energy efficiency and inference performance compared to CPUs and GPUs. Such accelerators are thus well suited for resource-constrained embedded…

Machine Learning · Computer Science 2021-07-13 Febin P. Sunny , Asif Mirza , Mahdi Nikdast , Sudeep Pasricha

The effectiveness of Recurrent Neural Networks (RNNs) for tasks such as Automatic Speech Recognition has fostered interest in RNN inference acceleration. Due to the recurrent nature and data dependencies of RNN computations, prior work has…

Machine Learning · Computer Science 2023-05-23 Reza Yazdani , Olatunji Ruwase , Minjia Zhang , Yuxiong He , Jose-Maria Arnau , Antonio Gonzalez

Artificial Neural Network (ANN)-based inference on battery-powered devices can be made more energy-efficient by restricting the synaptic weights to be binary, hence eliminating the need to perform multiplications. An alternative, emerging,…

Machine Learning · Computer Science 2020-12-16 Hyeryung Jang , Nicolas Skatchkovsky , Osvaldo Simeone

This paper develops a computationally efficient algorithm which speeds up the probabilistic power flow (PPF) problem by exploiting the inherently low-rank nature of the voltage profile in electrical power distribution networks. The…

Systems and Control · Electrical Eng. & Systems 2021-10-15 Samuel Chevalier , Luca Schenato , Luca Daniel

We present, QP-SBGD, a novel layer-wise stochastic optimiser tailored towards training neural networks with binary weights, known as binary neural networks (BNNs), on quantum hardware. BNNs reduce the computational requirements and energy…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Maximilian Krahn , Michele Sasdelli , Fengyi Yang , Vladislav Golyanik , Juho Kannala , Tat-Jun Chin , Tolga Birdal