中文
相关论文

相关论文: Computational Complexity Evaluation of Neural Netw…

200 篇论文

Post-training quantization is a representative technique for compressing neural networks, making them smaller and more efficient for deployment on edge devices. However, an inaccessible user dataset often makes it difficult to ensure the…

机器学习 · 计算机科学 2022-01-05 Donghyun Lee , Minkyoung Cho , Seungwon Lee , Joonho Song , Changkyu Choi

For efficient neural network inference, it is desirable to achieve state-of-the-art accuracy with the simplest networks requiring the least computation, memory, and power. Quantizing networks to lower precision is a powerful technique for…

We introduce a method to train Quantized Neural Networks (QNNs) --- neural networks with extremely low precision (e.g., 1-bit) weights and activations, at run-time. At train-time the quantized weights and activations are used for computing…

神经与进化计算 · 计算机科学 2016-09-23 Itay Hubara , Matthieu Courbariaux , Daniel Soudry , Ran El-Yaniv , Yoshua Bengio

The sensitivity of deep neural networks to compressed images hinders their usage in many real applications, which means classification networks may fail just after taking a screenshot and saving it as a compressed file. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2023-04-24 Li Ma , Peixi Peng , Guangyao Chen , Yifan Zhao , Siwei Dong , Yonghong Tian

Quantized neural networks with low-bit weights and activations are attractive for developing AI accelerators. However, the quantization functions used in most conventional quantization methods are non-differentiable, which increases the…

计算机视觉与模式识别 · 计算机科学 2020-09-21 Zhaohui Yang , Yunhe Wang , Kai Han , Chunjing Xu , Chao Xu , Dacheng Tao , Chang Xu

The combination of linear transformations and non-linear activation functions forms the foundation of most modern deep neural networks, enabling them to approximate highly complex functions. This paper explores the introduction of quadratic…

机器学习 · 计算机科学 2025-10-07 Qian Chen , Linxin Yang , Akang Wang , Xiaodong Luo , Yin Zhang

This paper performs a detailed, multi-faceted analysis of key challenges and common design caveats related to the development of efficient neural networks (NN) nonlinear channel equalizers in coherent optical communication systems. Our…

信号处理 · 电气工程与系统科学 2022-06-01 Pedro J. Freire , Antonio Napoli , Bernhard Spinnler , Nelson Costa , Sergei K. Turitsyn , Jaroslaw E. Prilepsky

There is a recent interest in neural network (NN)-based communication algorithms which have shown to achieve (beyond) state-of-the-art performance for a variety of problems or lead to reduced implementation complexity. However, most work on…

信息论 · 计算机科学 2019-02-20 Fayçal Ait Aoudia , Jakob Hoydis

Computational complexity is critical when deploying deep learning-based speech denoising models for on-device applications. Most prior research focused on optimizing model architectures to meet specific computational cost constraints, often…

音频与语音处理 · 电气工程与系统科学 2023-09-15 Hangting Chen , Jianwei Yu , Chao Weng

Deep neural networks are increasingly utilized in various machine learning tasks. However, as these models grow in complexity, they often face calibration issues, despite enhanced prediction accuracy. Many studies have endeavored to improve…

机器学习 · 计算机科学 2024-03-25 Linwei Tao , Younan Zhu , Haolan Guo , Minjing Dong , Chang Xu

Non-volatile memory (NVM) crossbars have been identified as a promising technology, for accelerating important machine learning operations, with matrix-vector multiplication being a key example. Binary neural networks (BNNs) are especially…

新兴技术 · 计算机科学 2023-08-14 Ruirong Huang , Zichao Yue , Caroline Huang , Janarbek Matai , Zhiru Zhang

Deep neural networks are extremely successful in various applications, however they exhibit high computational demands and energy consumption. This is exacerbated by stuttering technology scaling, prompting the need for novel approaches to…

机器学习 · 计算机科学 2024-06-17 Hendrik Borras , Bernhard Klein , Holger Fröning

In this work, we present a tutorial on how to account for the computational time complexity overhead of signal processing in the spectral efficiency (SE) analysis of wireless waveforms. Our methodology is particularly relevant in scenarios…

信号处理 · 电气工程与系统科学 2025-12-23 Saulo Queiroz , João P. Vilela , Benjamin Koon Kei Ng , Chan-Tong Lam , Edmundo Monteiro

Quantization of weights and activations in Deep Neural Networks (DNNs) is a powerful technique for network compression, and has enjoyed significant attention and success. However, much of the inference-time benefit of quantization is…

性能 · 计算机科学 2019-12-13 Andrew Anderson , David Gregg

Recent machine learning methods use increasingly large deep neural networks to achieve state of the art results in various tasks. The gains in performance come at the cost of a substantial increase in computation and storage requirements.…

机器学习 · 计算机科学 2019-03-26 Yoni Choukroun , Eli Kravchik , Fan Yang , Pavel Kisilev

Quantized deep neural networks (QDNNs) are necessary for low-power, high throughput, and embedded applications. Previous studies mostly focused on developing optimization methods for the quantization of given models. However, quantization…

机器学习 · 计算机科学 2020-06-02 Yoonho Boo , Sungho Shin , Wonyong Sung

Deep Neural Networks (DNNs) have gained immense success in cognitive applications and greatly pushed today's artificial intelligence forward. The biggest challenge in executing DNNs is their extremely data-extensive computations. The…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Fuqiang Liu , C. Liu

Deep neural networks (DNNs) are essential for performing advanced tasks on edge or mobile devices, yet their deployment is often hindered by severe resource constraints, including limited memory, energy, and computational power. While…

机器学习 · 计算机科学 2026-03-04 Qunyou Liu , Pengbo Yu , Marina Zapater , David Atienza

Complex Networks are a good approach to find internal relationships and represent the structure of classes in a dataset then they are used for High Level Classification. Previous works use K-Nearest Neighbors to build each Complex Network…

机器学习 · 计算机科学 2021-10-26 Josimar Chire

The quest for a scientific description of consciousness has given rise to new theoretical and empirical paradigms for the investigation of phenomenological contents as well as clinical disorders of consciousness. An outstanding challenge in…

神经元与认知 · 定量生物学 2018-01-12 Xerxes D. Arsiwalla , Paul Verschure