中文
相关论文

相关论文: Automated Heterogeneous Low-Bit Quantization of Mu…

200 篇论文

Deep Neural Networks (DNNs) have achieved great success in a variety of machine learning (ML) applications, delivering high-quality inferencing solutions in computer vision, natural language processing, and virtual reality, etc. However,…

机器学习 · 计算机科学 2022-08-29 Xiaofan Zhang , Yao Chen , Cong Hao , Sitao Huang , Yuhong Li , Deming Chen

The deep neural networks (DNNs) have been enormously successful in tasks that were hitherto in the human-only realm such as image recognition, and language translation. Owing to their success the DNNs are being explored for use in ever more…

分布式、并行与集群计算 · 计算机科学 2019-06-20 Sanket Tavarageri , Srinivas Sridharan , Bharat Kaul

There is a growing demand to deploy computation-intensive deep learning (DL) models on resource-constrained mobile devices for real-time intelligent applications. Equipped with a variety of processing units such as CPUs, GPUs, and NPUs, the…

机器学习 · 计算机科学 2024-05-06 Sicong Liu , Wentao Zhou , Zimu Zhou , Bin Guo , Minfan Wang , Cheng Fang , Zheng Lin , Zhiwen Yu

Automated Machine Learning with ensembling (or AutoML with ensembling) seeks to automatically build ensembles of Deep Neural Networks (DNNs) to achieve qualitative predictions. Ensemble of DNNs are well known to avoid over-fitting but they…

机器学习 · 计算机科学 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Efficient deep neural network (DNN) inference on mobile or embedded devices typically involves quantization of the network parameters and activations. In particular, mixed precision networks achieve better performance than networks with…

Training deep neural networks (DNNs) in large-cluster computing environments is increasingly necessary, as networks grow in size and complexity. Local memory and processing limitations require robust data and model parallelism for crossing…

机器学习 · 计算机科学 2020-06-08 Russell J. Hewett , Thomas J. Grady

In this paper, we develop a unified machine learning (ML) approach to predict high-quality solutions for single-machine scheduling problems with a non-decreasing min-sum objective function with or without release times. Our ML approach is…

最优化与控制 · 数学 2025-01-09 Anbang Liu , Zhi-Long Chen , Jinyang Jiang , Xi Chen

This review presents a comprehensive exploration of hybrid and ensemble deep learning models within Natural Language Processing (NLP), shedding light on their transformative potential across diverse tasks such as Sentiment Analysis, Named…

人工智能 · 计算机科学 2024-08-09 Jianguo Jia , Wen Liang , Youzhi Liang

Deep neural networks (DNNs) are ubiquitous in computer vision and natural language processing, but suffer from high inference cost. This problem can be addressed by quantization, which consists in converting floating point perations into a…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Edouard Yvinec , Arnaud Dapogny , Kevin Bailly

Deep neural networks (DNNs) have been deployed in myriad machine learning applications. However, advances in their accuracy are often achieved with increasingly complex and deep network architectures. These large, deep models are often…

机器学习 · 计算机科学 2020-04-22 Wenhan Xia , Hongxu Yin , Niraj K. Jha

In real applications, different computation-resource devices need different-depth networks (e.g., ResNet-18/34/50) with high-accuracy. Usually, existing methods either design multiple networks and train them independently, or construct…

计算机视觉与模式识别 · 计算机科学 2021-08-11 Qi Zhao , Shuchang Lyu , Zhiwei Zhang , Ting-Bing Xu , Guangliang Cheng

Deep neural networks (DNNs) are becoming more prevalent in important safety-critical applications, where reliability in the prediction is paramount. Despite their exceptional prediction capabilities, current DNNs do not have an implicit…

机器学习 · 计算机科学 2021-05-14 David Betancourt , Rafi Muhanna

Deep Learning is moving to edge devices, ushering in a new age of distributed Artificial Intelligence (AI). The high demand of computational resources required by deep neural networks may be alleviated by approximate computing techniques,…

神经与进化计算 · 计算机科学 2018-11-15 Miguel de Prado , Maurizio Denna , Luca Benini , Nuria Pazos

Ensembles of Deep Neural Networks (DNNs) have achieved qualitative predictions but they are computing and memory intensive. Therefore, the demand is growing to make them answer a heavy workload of requests with available computational…

分布式、并行与集群计算 · 计算机科学 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Deep Learning (DL) methods show very good performance when trained on large, balanced data sets. However, many practical problems involve imbalanced data sets, or/and classes with a small number of training samples. The performance of DL…

机器学习 · 计算机科学 2017-02-07 Dolev Raviv , Margarita Osadchy

Ensemble learning has gain attention in resent deep learning research as a way to further boost the accuracy and generalizability of deep neural network (DNN) models. Recent ensemble training method explores different training algorithms or…

机器学习 · 计算机科学 2023-01-20 Jingchi Zhang , Huanrui Yang , Hai Li

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do…

机器学习 · 计算机科学 2023-02-21 Romit Maulik , Romain Egele , Krishnan Raghavan , Prasanna Balaprakash

Quantifying uncertainty in a model's predictions is important as it enables the safety of an AI system to be increased by acting on the model's output in an informed manner. This is crucial for applications where the cost of an error is…

计算机视觉与模式识别 · 计算机科学 2021-05-31 Aria Khoshsirat

Although weight and activation quantization is an effective approach for Deep Neural Network (DNN) compression and has a lot of potentials to increase inference speed leveraging bit-operations, there is still a noticeable gap in terms of…

计算机视觉与模式识别 · 计算机科学 2018-07-27 Dongqing Zhang , Jiaolong Yang , Dongqiangzi Ye , Gang Hua

Computation offloading has become a popular solution to support computationally intensive and latency-sensitive applications by transferring computing tasks to mobile edge servers (MESs) for execution, which is known as mobile/multi-access…

信号处理 · 电气工程与系统科学 2023-09-06 Ruihuai Liang , Bo Yang , Zhiwen Yu , Xuelin Cao , Derrick Wing Kwan Ng , Chau Yuen