中文
相关论文

相关论文: TDC: Towards Extremely Efficient CNNs on GPUs via …

200 篇论文

Channel pruning and tensor decomposition have received extensive attention in convolutional neural network compression. However, these two techniques are traditionally deployed in an isolated manner, leading to significant accuracy drop…

计算机视觉与模式识别 · 计算机科学 2021-05-25 Yuchao Li , Shaohui Lin , Jianzhuang Liu , Qixiang Ye , Mengdi Wang , Fei Chao , Fan Yang , Jincheng Ma , Qi Tian , Rongrong Ji

This paper studies the computational offloading of CNN inference in device-edge co-inference systems. Inspired by the emerging paradigm semantic communication, we propose a novel autoencoder-based CNN architecture (AECNN), for effective…

计算机视觉与模式识别 · 计算机科学 2023-02-13 Nan Li , Alexandros Iosifidis , Qi Zhang

In this paper we propose a novel decomposition method based on filter group approximation, which can significantly reduce the redundancy of deep convolutional neural networks (CNNs) while maintaining the majority of feature representation.…

计算机视觉与模式识别 · 计算机科学 2018-08-01 Bo Peng , Wenming Tan , Zheyang Li , Shun Zhang , Di Xie , Shiliang Pu

Lossy image compression (LIC), which aims to utilize inexact approximations to represent an image more compactly, is a classical problem in image processing. Recently, deep convolutional neural networks (CNNs) have achieved interesting…

计算机视觉与模式识别 · 计算机科学 2018-07-11 Jianrui Cai , Zisheng Cao , Lei Zhang

Over the years, accelerating neural networks with quantization has been widely studied. Unfortunately, prior efforts with diverse precisions (e.g., 1-bit weights and 2-bit activations) are usually restricted by limited precision support on…

分布式、并行与集群计算 · 计算机科学 2021-11-18 Boyuan Feng , Yuke Wang , Tong Geng , Ang Li , Yufei Ding

Convolutional neural networks (CNNs) are among the most widely used machine learning models for computer vision tasks, such as image classification. To improve the efficiency of CNNs, many CNNs compressing approaches have been developed.…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Mateusz Gabor , Rafał Zdunek

We propose an efficient and unified framework, namely ThiNet, to simultaneously accelerate and compress CNN models in both training and inference stages. We focus on the filter level pruning, i.e., the whole filter would be discarded if it…

计算机视觉与模式识别 · 计算机科学 2017-07-21 Jian-Hao Luo , Jianxin Wu , Weiyao Lin

Various applications in the field of autonomous driving are based on convolutional neural networks (CNNs), especially for processing camera data. The optimization of such CNNs is a major challenge in continuous development. Newly learned…

Tensor decompositions are promising tools for big data analytics as they bring multiple modes and aspects of data to a unified framework, which allows us to discover complex internal structures and correlations of data. Unfortunately most…

数值分析 · 计算机科学 2014-12-30 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

This paper is focused on the improvement the efficiency of the sparse convolutional neural networks (CNNs) layers on graphic processing units (GPU). The Nvidia deep neural network (cuDnn) library provides the most effective implementation…

机器学习 · 计算机科学 2022-01-03 Marcin Pietroń , Dominik Żurek

This paper optimizes the Convolutional Neural Network (CNN) algorithm using high-performance computing (HPC) technologies. It uses multi-core processors, GPUs, and parallel computing frameworks like OpenMPI and CUDA to speed up CNN model…

分布式、并行与集群计算 · 计算机科学 2024-03-11 Shahrin Rahman

Convolutional Neural Networks (CNN) are becoming a common presence in many applications and services, due to their superior recognition accuracy. They are increasingly being used on mobile devices, many times just by porting large models…

Recurrent Neural Networks (RNNs) have been widely used in sequence analysis and modeling. However, when processing high-dimensional data, RNNs typically require very large model sizes, thereby bringing a series of deployment challenges.…

机器学习 · 计算机科学 2020-05-12 Miao Yin , Siyu Liao , Xiao-Yang Liu , Xiaodong Wang , Bo Yuan

Tensor computation has emerged as a powerful mathematical tool for solving high-dimensional and/or extreme-scale problems in science and engineering. The last decade has witnessed tremendous advancement of tensor computation and its…

信号处理 · 电气工程与系统科学 2019-07-05 Kaiqi Zhang , Xiyuan Zhang , Zheng Zhang

This work is focused on the pruning of some convolutional neural networks (CNNs) and improving theirs efficiency on graphic processing units (GPU) by using a direct sparse algorithm. The Nvidia deep neural network (cuDnn) library is the…

机器学习 · 计算机科学 2022-08-30 Marcin Pietroń , Dominik Żurek

In recent years, Convolutional Neural Network (CNN) based methods have achieved great success in a large number of applications and have been among the most powerful and widely used techniques in computer vision. However, CNN-based methods…

机器学习 · 计算机科学 2019-11-18 Ali Jahanshahi

Most currently used tensor regression models for high-dimensional data are based on Tucker decomposition, which has good properties but loses its efficiency in compressing tensors very quickly as the order of tensors increases, say greater…

统计方法学 · 统计学 2024-03-20 Yuefeng Si , Yingying Zhang , Yuxi Cai , Chunling Liu , Guodong Li

Tensor robust principal component analysis (TRPCA) is a fundamental model in machine learning and computer vision. Recently, tensor train (TT) decomposition has been verified effective to capture the global low-rank correlation for tensor…

机器学习 · 计算机科学 2022-03-14 Yuning Qiu , Guoxu Zhou , Zhenhao Huang , Qibin Zhao , Shengli Xie

Tensor decomposition is one of the fundamental technique for model compression of deep convolution neural networks owing to its ability to reveal the latent relations among complex structures. However, most existing methods compress the…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Bo-Shiuan Chu , Che-Rung Lee

Recurrent Neural Networks (RNNs) have been widely used in sequence analysis and modeling. However, when processing high-dimensional data, RNNs typically require very large model sizes, thereby bringing a series of deployment challenges.…

计算机视觉与模式识别 · 计算机科学 2021-04-21 Miao Yin , Siyu Liao , Xiao-Yang Liu , Xiaodong Wang , Bo Yuan