中文
相关论文

相关论文: Accurate and Efficient Hyperbolic Tangent Activati…

200 篇论文

Deep neural networks (DNNs) are becoming increasingly deeper, wider, and non-linear due to the growing demands on prediction accuracy and analysis quality. When training a DNN model, the intermediate activation data must be saved in the…

分布式、并行与集群计算 · 计算机科学 2020-11-24 Sian Jin , Guanpeng Li , Shuaiwen Leon Song , Dingwen Tao

Quantization of weights and activations in Deep Neural Networks (DNNs) is a powerful technique for network compression, and has enjoyed significant attention and success. However, much of the inference-time benefit of quantization is…

性能 · 计算机科学 2019-12-13 Andrew Anderson , David Gregg

Objective: To propose novel SSVEP classification methodologies using deep neural networks (DNNs) and improve performances in single-channel and user-independent brain-computer interfaces (BCIs) with small data lengths. Approach: We propose…

信号处理 · 电气工程与系统科学 2022-04-05 Pedro R. A. S. Bassi , Romis Attux

A neural network is essentially a high-dimensional complex mapping model by adjusting network weights for feature fitting. However, the spectral bias in network training leads to unbearable training epochs for fitting the high-frequency…

信号处理 · 电气工程与系统科学 2021-06-22 Zhi Zeng , Pengpeng Shi , Fulei Ma , Peihan Qi

Recently, data-driven approaches motivated by modern deep learning have been applied to optical communications in place of traditional model-based counterparts. The application of deep neural networks (DNN) allows flexible statistical…

信号处理 · 电气工程与系统科学 2019-11-25 Toshiaki Koike-Akino , Ye Wang , David S. Millar , Keisuke Kojima , Kieran Parsons

Deep Neural Networks (DNNs) have gained immense success in cognitive applications and greatly pushed today's artificial intelligence forward. The biggest challenge in executing DNNs is their extremely data-extensive computations. The…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Fuqiang Liu , C. Liu

The process of training a deep neural network is characterized by significant time requirements and associated costs. Although researchers have made considerable progress in this area, further work is still required due to resource…

Hydrogen bonding is an important non-covalent interaction that plays a major role in molecular self-organization and supramolecular structures. It can be described accurately with ab initio quantum chemical wave function methods, which…

化学物理 · 物理学 2025-05-16 Usman Ahmed , Mikael P. Johansson , Susi Lehtola , Dage Sundholm

We introduce Dynamic Deep Neural Networks (D2NN), a new type of feed-forward deep neural network that allows selective execution. Given an input, only a subset of D2NN neurons are executed, and the particular subset is determined by the…

机器学习 · 计算机科学 2018-03-06 Lanlan Liu , Jia Deng

Mixed-precision quantization is a popular approach for compressing deep neural networks (DNNs). However, it is challenging to scale the performance efficiently with mixed-precision DNNs given the current FPGA architecture and conventional…

硬件体系结构 · 计算机科学 2023-11-07 Yuzong Chen , Jordan Dotzel , Mohamed S. Abdelfattah

Convolutional Neural Networks (CNNs) reach high accuracies in various application domains, but require large amounts of computation and incur costly data movements. One method to decrease these costs while trading accuracy is weight and/or…

硬件体系结构 · 计算机科学 2022-08-10 Cecilia Latotzke , Tim Ciesielski , Tobias Gemmeke

Approximate computing is known for enhancing deep neural network accelerators' energy efficiency by introducing inexactness with a tolerable accuracy loss. However, small accuracy variations may increase the sensitivity of these…

硬件体系结构 · 计算机科学 2023-02-23 Ayesha Siddique , Khaza Anuarul Hoque

The mathematical complexity and high dimensionality of neural networks slow both training and deployment, demanding heavy computational resources. This has driven the search for alternative architectures built from novel components,…

应用物理 · 物理学 2025-12-15 Jake McNaughton , A. H. Abbas , Ivan S. Maksymov

In this paper, we propose a novel method using Deep Neural Networks (DNNs) to optimise the parameters of pulse waveforms used for manipulating qubit states, resulting in high fidelity implementation of qubit gates. High fidelity quantum…

量子物理 · 物理学 2024-08-06 Zachary Fillingham , Hossein Nevisi , Shirin Dora

We propose a Digital Neuron, a hardware inference accelerator for convolutional deep neural networks with integer inputs and integer weights for embedded systems. The main idea to reduce circuit area and power consumption is manipulating…

信号处理 · 电气工程与系统科学 2019-02-08 Hyunbin Park , Dohyun Kim , Shiho Kim

Deep Neural Networks (DNNs) are extensively employed in safety-critical applications where ensuring hardware reliability is a primary concern. To enhance the reliability of DNNs against hardware faults, activation restriction techniques…

Aiming for the median solution between cyber-intensive optimal power flow (OPF) solutions and subpar local control, this work advocates deciding inverter injection setpoints using deep neural networks (DNNs). Instead of fitting OPF…

最优化与控制 · 数学 2020-07-14 Sarthak Gupta , Vassilis Kekatos , Ming Jin

This paper aims at rapid deployment of the state-of-the-art deep neural networks (DNNs) to energy efficient accelerators without time-consuming fine tuning or the availability of the full datasets. Converting DNNs in full precision to…

神经与进化计算 · 计算机科学 2018-10-15 Jun Haeng Lee , Sangwon Ha , Saerom Choi , Won-Jo Lee , Seungwon Lee

To improve the throughput and energy efficiency of Deep Neural Networks (DNNs) on customized hardware, lightweight neural networks constrain the weights of DNNs to be a limited combination (denoted as $k\in\{1,2\}$) of powers of 2. In such…

计算机视觉与模式识别 · 计算机科学 2019-04-08 Ruizhou Ding , Zeye Liu , Ting-Wu Chin , Diana Marculescu , R. D. , Blanton

Load balancing (LB) is a challenging issue in the hybrid light fidelity (LiFi) and wireless fidelity (WiFi) networks (HLWNets), due to the nature of heterogeneous access points (APs). Machine learning has the potential to provide a…

信号处理 · 电气工程与系统科学 2022-08-11 Han Ji , Qiang Wang , Stephen J. Redmond , Iman Tavakkolnia , Xiping Wu