中文
相关论文

相关论文: Realizing Unaligned Block-wise Pruning for DNN Acc…

200 篇论文

Resource allocation in wireless networks, such as device-to-device (D2D) communications, is usually formulated as mixed integer nonlinear programming (MINLP) problems, which are generally NP-hard and difficult to get the optimal solutions.…

信息论 · 计算机科学 2020-12-22 Mengyuan Lee , Guanding Yu , Geoffrey Ye Li

It is always well believed that Binary Neural Networks (BNNs) could drastically accelerate the inference efficiency by replacing the arithmetic operations in float-valued Deep Neural Networks (DNNs) with bit-wise operations. Nevertheless,…

计算机视觉与模式识别 · 计算机科学 2019-08-19 Jianhao Zhang , Yingwei Pan , Ting Yao , He Zhao , Tao Mei

Distributed deep neural networks (DNNs) have become central to modern computer vision, yet their deployment on resource-constrained edge devices remains hindered by substantial parameter counts, computational demands, and the probability of…

分布式、并行与集群计算 · 计算机科学 2026-02-17 Mahadev Sunil Kumar , Arnab Raha , Debayan Das , Gopakumar G , Rounak Chatterjee , Amitava Mukherjee

Bit-level sparsity methods skip ineffectual zero-bit operations and are typically applicable within bit-serial deep learning accelerators. This type of sparsity at the bit-level is especially interesting because it is both orthogonal and…

机器学习 · 计算机科学 2024-09-10 Yuzong Chen , Jian Meng , Jae-sun Seo , Mohamed S. Abdelfattah

In the world of deep learning, Transformer models have become very significant, leading to improvements in many areas from understanding language to recognizing images, covering a wide range of applications. Despite their success, the…

With the growth of interest in the attack and defense of deep neural networks, researchers are focusing more on the robustness of applying them to devices with limited memory. Thus, unlike adversarial training, which only considers the…

机器学习 · 计算机科学 2021-09-10 Haidong Xie , Lixin Qian , Xueshuang Xiang , Naijin Liu

Deep learning algorithms are increasingly employed at the edge. However, edge devices are resource constrained and thus require efficient deployment of deep neural networks. Pruning methods are a key tool for edge deployment as they can…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Yunqiang Li , Jan C. van Gemert , Torsten Hoefler , Bert Moons , Evangelos Eleftheriou , Bram-Ernst Verhoef

To address the challenge of increasing network size, researchers have developed sparse models through network pruning. However, maintaining model accuracy while achieving significant speedups on general computing devices remains an open…

人工智能 · 计算机科学 2023-10-31 Haitao Xu , Songwei Liu , Yuyang Xu , Shuai Wang , Jiashi Li , Chenqian Yan , Liangqiang Li , Lean Fu , Xin Pan , Fangmin Chen

Deep Neural Networks (DNNs) have significantly improved the accuracy of intelligent applications on mobile devices. DNN surgery, which partitions DNN processing between mobile devices and multi-access edge computing (MEC) servers, can…

计算机科学与博弈论 · 计算机科学 2023-06-22 Xiang Yang , Dezhi Chen , Qi Qi , Jingyu Wang , Haifeng Sun , Jianxin Liao , Song Guo

Model compression techniques on Deep Neural Network (DNN) have been widely acknowledged as an effective way to achieve acceleration on a variety of platforms, and DNN weight pruning is a straightforward and effective method. There are…

机器学习 · 计算机科学 2020-03-06 Xiaolong Ma , Fu-Ming Guo , Wei Niu , Xue Lin , Jian Tang , Kaisheng Ma , Bin Ren , Yanzhi Wang

Recent breakthroughs in deep learning (DL) have led to the emergence of many intelligent mobile applications and services, but in the meanwhile also pose unprecedented computing challenges on resource-constrained mobile devices. This paper…

机器学习 · 计算机科学 2021-02-05 Letian Zhang , Lixing Chen , Jie Xu

Deep neural networks (DNNs) sustain high performance in today's data processing applications. DNN inference is resource-intensive thus is difficult to fit into a mobile device. An alternative is to offload the DNN inference to a cloud…

分布式、并行与集群计算 · 计算机科学 2021-01-18 Beibei Zhang , Tian Xiang , Hongxuan Zhang , Te Li , Shiqiang Zhu , Jianjun Gu

The deep neural network (DNN) based AI applications on the edge require both low-cost computing platforms and high-quality services. However, the limited memory, computing resources, and power budget of the edge devices constrain the…

机器学习 · 计算机科学 2021-05-14 Yao Chen , Cole Hawkins , Kaiqi Zhang , Zheng Zhang , Cong Hao

In seismic exploration, first break (FB) picking is a crucial aspect in the determination of subsurface velocity models, significantly influencing the placement of wells. Many deep neural networks (DNNs)-based automatic picking methods have…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Hongtao Wang , Jiangshe Zhang , Xiaoli Wei , Li Long , Chunxia Zhang

As we push the boundaries of performance in various vision tasks, the models grow in size correspondingly. To keep up with this growth, we need very aggressive pruning techniques for efficient inference and deployment on edge devices.…

计算机视觉与模式识别 · 计算机科学 2024-06-19 Xinglong Sun , Barath Lakshmanan , Maying Shen , Shiyi Lan , Jingde Chen , Jose Alvarez

Deploying deep neural networks (DNNs) on resource-constrained mobile devices presents significant challenges, particularly in achieving real-time performance while simultaneously coping with limited computational resources and battery life.…

网络与互联网体系结构 · 计算机科学 2025-09-24 Zekai Sun , Xiuxian Guan , Zheng Lin , Zihan Fang , Xiangming Cai , Zhe Chen , Fangming Liu , Heming Cui , Jie Xiong , Wei Ni , Chau Yuen

Precision scaling has emerged as a popular technique to optimize the compute and storage requirements of Deep Neural Networks (DNNs). Efforts toward creating ultra-low-precision (sub-8-bit) DNNs suggest that the minimum precision required…

机器学习 · 计算机科学 2021-11-01 Reena Elangovan , Shubham Jain , Anand Raghunathan

Mobile devices run deep learning models for various purposes, such as image classification and speech recognition. Due to the resource constraints of mobile devices, researchers have focused on either making a lightweight deep neural…

机器学习 · 计算机科学 2022-07-22 Taeho Kim , Yongin Kwon , Jemin Lee , Taeho Kim , Sangtae Ha

Currently, an increasing number of model pruning methods are proposed to resolve the contradictions between the computer powers required by the deep learning models and the resource-constrained devices. However, most of the traditional…

计算机视觉与模式识别 · 计算机科学 2021-10-11 Jiaqi Li , Haoran Li , Yaran Chen , Zixiang Ding , Nannan Li , Mingjun Ma , Zicheng Duan , Dongbing Zhao

With the prosperity of mobile devices, the distributed learning approach enabling model training with decentralized data has attracted wide research. However, the lack of training capability for edge devices significantly limits the energy…

机器学习 · 计算机科学 2021-05-14 Ziyang Hong , C. Patrick Yue