中文
相关论文

相关论文: Automatic Network Adaptation for Ultra-Low Uniform…

200 篇论文

Post-training, layer-wise quantization is preferable because it is free from retraining and is hardware-friendly. Nevertheless, accuracy degradation has occurred when a neural network model has a big difference of per-out-channel weight…

机器学习 · 计算机科学 2020-08-14 Jihun Oh , SangJeong Lee , Meejeong Park , Pooni Walagaurav , Kiseok Kwon

Deep Neural Networks (DNNs) are applied in a wide range of usecases. There is an increased demand for deploying DNNs on devices that do not have abundant resources such as memory and computation units. Recently, network compression through…

机器学习 · 计算机科学 2020-05-19 Haichuan Yang , Shupeng Gui , Yuhao Zhu , Ji Liu

Quantization for deep neural networks have afforded models for edge devices that use less on-board memory and enable efficient low-power inference. In this paper, we present a comparison of model-parameter driven quantization approaches…

计算机视觉与模式识别 · 计算机科学 2019-10-14 Prateeth Nayak , David Zhang , Sek Chai

Quantization has become a popular technique to compress neural networks and reduce compute cost, but most prior work focuses on studying quantization without changing the network size. Many real-world applications of neural networks have…

Single-shot imaging with femtosecond X-ray lasers is a powerful measurement technique that can achieve both high spatial and temporal resolution. However, its accuracy has been severely limited by the difficulty of applying conventional…

In this study, we propose a novel architecture, the Quantum Pointwise Convolution, which incorporates pointwise convolution within a quantum neural network framework. Our approach leverages the strengths of pointwise convolution to…

机器学习 · 计算机科学 2024-12-03 An Ning , Tai-Yue Li , Nan-Yow Chen

The prediction accuracy of the deep neural networks (DNNs) after deployment at the edge can suffer with time due to shifts in the distribution of the new data. To improve robustness of DNNs, they must be able to update themselves to enhance…

机器学习 · 计算机科学 2022-03-23 Kshitij Bhardwaj , James Diffenderfer , Bhavya Kailkhura , Maya Gokhale

We propose a novel method for neural network quantization that casts the neural architecture search problem as one of hyperparameter search to find non-uniform bit distributions throughout the layers of a CNN. We perform the search assuming…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Marcelo Gennari do Nascimento , Theo W. Costain , Victor Adrian Prisacariu

Convolutional Neural Networks (CNNs) reach high accuracies in various application domains, but require large amounts of computation and incur costly data movements. One method to decrease these costs while trading accuracy is weight and/or…

硬件体系结构 · 计算机科学 2022-08-10 Cecilia Latotzke , Tim Ciesielski , Tobias Gemmeke

Although convolutional neural networks (CNNs) are now widely used in various computer vision applications, its huge resource demanding on parameter storage and computation makes the deployment on mobile and embedded devices difficult.…

计算机视觉与模式识别 · 计算机科学 2019-09-26 Zhe Xu , Ray C. C. Cheung

It is often the case that the performance of a neural network can be improved by adding layers. In real-world practices, we always train dozens of neural network architectures in parallel which is a wasteful process. We explored $CompNet$,…

神经与进化计算 · 计算机科学 2018-04-30 Jun Lu , Wei Ma , Boi Faltings

There is a constant need for high-performing and computationally efficient neural network models for image super-resolution: computationally efficient models can be used via low-capacity devices and reduce carbon footprints. One way to…

计算机视觉与模式识别 · 计算机科学 2024-01-11 Egor Shvetsov , Dmitry Osin , Alexey Zaytsev , Ivan Koryakovskiy , Valentin Buchnev , Ilya Trofimov , Evgeny Burnaev

Neural Networks are currently one of the most widely deployed machine learning algorithms. In particular, Convolutional Neural Networks (CNNs), are gaining popularity and are evaluated for deployment in safety critical applications such as…

信号处理 · 电气工程与系统科学 2019-12-17 Giulio Gambardella , Johannes Kappauf , Michaela Blott , Christoph Doehring , Martin Kumm , Peter Zipf , Kees Vissers

Convolution Neural Networks (CNN) have been extremely successful in solving intensive computer vision tasks. The convolutional filters used in CNNs have played a major role in this success, by extracting useful features from the inputs.…

计算机视觉与模式识别 · 计算机科学 2020-01-08 Pravendra Singh , Pratik Mazumder , Vinay P. Namboodiri

The sensitivity of deep neural networks to compressed images hinders their usage in many real applications, which means classification networks may fail just after taking a screenshot and saving it as a compressed file. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2023-04-24 Li Ma , Peixi Peng , Guangyao Chen , Yifan Zhao , Siwei Dong , Yonghong Tian

Existing neural networks are memory-consuming and computationally intensive, making deploying them challenging in resource-constrained environments. However, there are various methods to improve their efficiency. Two such methods are…

机器学习 · 计算机科学 2023-11-10 Anastasiia Prutianova , Alexey Zaytsev , Chung-Kuei Lee , Fengyu Sun , Ivan Koryakovskiy

Convolutional Neural Networks (CNNs) have advanced significantly in visual representation learning and recognition. However, they face notable challenges in performance and computational efficiency when dealing with real-world, multi-scale…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

In this paper, we propose a novel layer-adaptive weight-pruning approach for Deep Neural Networks (DNNs) that addresses the challenge of optimizing the output distortion minimization while adhering to a target pruning ratio constraint. Our…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Kaixin Xu , Zhe Wang , Xue Geng , Jie Lin , Min Wu , Xiaoli Li , Weisi Lin

In this paper, we study the tunable quantum neural network architecture in the quantum exact learning framework with access to a uniform quantum example oracle. We present an approach that uses amplitude amplification to correctly tune the…

量子物理 · 物理学 2023-09-04 Viet Pham Ngoc , Herbert Wiklicky

Convolutional Neural Networks (CNNs) are the current de-facto models used for many imaging tasks due to their high learning capacity as well as their architectural qualities. The ubiquitous UNet architecture provides an efficient and…

图像与视频处理 · 电气工程与系统科学 2020-09-30 Demetris Marnerides , Thomas Bashford-Rogers , Kurt Debattista