中文
相关论文

相关论文: Minimal Filtering Algorithms for Convolutional Neu…

200 篇论文

We propose new primal-dual decomposition algorithms for solving systems of inclusions involving sums of linearly composed maximally monotone operators. The principal innovation in these algorithms is that they are block-iterative in the…

最优化与控制 · 数学 2015-11-30 Patrick L. Combettes , Jonathan Eckstein

In this paper, we present a simple yet effective padding scheme that can be used as a drop-in module for existing convolutional neural networks. We call it partial convolution based padding, with the intuition that the padded region can be…

计算机视觉与模式识别 · 计算机科学 2018-11-29 Guilin Liu , Kevin J. Shih , Ting-Chun Wang , Fitsum A. Reda , Karan Sapra , Zhiding Yu , Andrew Tao , Bryan Catanzaro

Winograd is generally utilized to optimize convolution performance and computational efficiency because of the reduced multiplication operations, but the reliability issues brought by winograd are usually overlooked. In this work, we…

机器学习 · 计算机科学 2023-08-17 Xinghua Xue , Cheng Liu , Bo Liu , Haitong Huang , Ying Wang , Tao Luo , Lei Zhang , Huawei Li , Xiaowei Li

Adder neural network (AdderNet) is a new kind of deep model that replaces the original massive multiplications in convolutions by additions while preserving the high performance. Since the hardware complexity of additions is much lower than…

机器学习 · 计算机科学 2021-05-13 Wenshuo Li , Hanting Chen , Mingqiang Huang , Xinghao Chen , Chunjing Xu , Yunhe Wang

For the practical implementation of massive multiple-input multiple-output (MIMO) systems, the hybrid processing (precoding/combining) structure is promising to reduce the high cost rendered by large number of RF chains of the traditional…

信息论 · 计算机科学 2015-04-16 Weiheng Ni , Xiaodai Dong , Wu-Sheng Lu

Recent works on neural network pruning advocate that reducing the depth of the network is more effective in reducing run-time memory usage and accelerating inference latency than reducing the width of the network through channel pruning. In…

机器学习 · 计算机科学 2023-06-05 Jinuk Kim , Yeonwoo Jeong , Deokjae Lee , Hyun Oh Song

Filter pruning is one of the most effective ways to accelerate and compress convolutional neural networks (CNNs). In this work, we propose a global filter pruning algorithm called Gate Decorator, which transforms a vanilla CNN module by…

计算机视觉与模式识别 · 计算机科学 2019-09-19 Zhonghui You , Kun Yan , Jinmian Ye , Meng Ma , Ping Wang

2D convolution is a staple of digital image processing. The advent of large format imagers makes it possible to literally ``pave'' with silicon the focal plane of an optical sensor, which results in very large images that can require a…

天体物理学 · 物理学 2015-05-26 Jeremy Kepner

Convolutional neural networks (CNNs) are typically over-parameterized, bringing considerable computational overhead and memory footprint in inference. Pruning a proportion of unimportant filters is an efficient way to mitigate the inference…

计算机视觉与模式识别 · 计算机科学 2020-05-07 Kai Zhao , Xin-Yu Zhang , Qi Han , Ming-Ming Cheng

Energy minimization has been an intensely studied core problem in computer vision. With growing image sizes (2D and 3D), it is now highly desirable to run energy minimization algorithms in parallel. But many existing algorithms, in…

计算机视觉与模式识别 · 计算机科学 2015-03-06 K. S. Sesh Kumar , Alvaro Barbero , Stefanie Jegelka , Suvrit Sra , Francis Bach

Graph partitioning schedules parallel calculations like sparse matrix-vector multiply (SpMV). We consider contiguous partitions, where the $m$ rows (or columns) of a sparse matrix with $N$ nonzeros are split into $K$ parts without…

数据结构与算法 · 计算机科学 2024-10-30 Willow Ahrens

Convolutional Neural Networks (CNNs) achieve high performance in image classification tasks but are challenging to deploy on resource-limited hardware due to their large model sizes. To address this issue, we leverage Mutual Information, a…

机器学习 · 计算机科学 2024-11-28 Tien Vu-Van , Dat Du Thanh , Nguyen Ho , Mai Vu

Convolution operations are foundational to classical image processing and modern deep learning architectures, yet their extension into the quantum domain has remained algorithmically and physically costly due to inefficient data encoding…

量子物理 · 物理学 2025-07-29 Mohammad Rasoul Roshanshah , Payman Kazemikhah , Hossein Aghababa

Bloom filters are a fundamental data structure for approximate membership queries, with applications ranging from data analytics to databases and genomics. Several variants have been proposed to accommodate parallel architectures. GPUs,…

分布式、并行与集群计算 · 计算机科学 2025-12-18 Daniel Jünger , Kevin Kristensen , Yunsong Wang , Xiangyao Yu , Bertil Schmidt

The deployment of Convolutional Neural Networks (CNNs) on resource constrained platforms such as mobile devices and embedded systems has been greatly hindered by their high implementation cost, and thus motivated a lot research interest in…

计算机视觉与模式识别 · 计算机科学 2019-08-12 Boyu Zhang , Azadeh Davoodi , Yu Hen Hu

Deep convolutional neural networks contain tens of millions of parameters, making them impossible to work efficiently on embedded devices. We propose iterative approach of applying low-rank approximation to compress deep convolutional…

计算机视觉与模式识别 · 计算机科学 2019-11-18 Maksym Kholiavchenko

We introduce and analyze an algorithm for the minimization of convex functions that are the sum of differentiable terms and proximable terms composed with linear operators. The method builds upon the recently developed smoothed gap…

最优化与控制 · 数学 2017-06-20 Quang Van Nguyen , Olivier Fercoq , Volkan Cevher

In this paper, we propose a mixed-precision convolution unit architecture which supports different integer and floating point (FP) precisions. The proposed architecture is based on low-bit inner product units and realizes higher precision…

硬件体系结构 · 计算机科学 2021-01-29 Hamzah Abdel-Aziz , Ali Shafiee , Jong Hoon Shin , Ardavan Pedram , Joseph H. Hassoun

Deep neural networks (DNNs) require very large amounts of computation both for training and for inference when deployed in the field. A common approach to implementing DNNs is to recast the most computationally expensive operations as…

计算机视觉与模式识别 · 计算机科学 2017-09-12 Andrew Anderson , Aravind Vasudevan , Cormac Keane , David Gregg

The minimum cost multicut problem is the NP-hard/APX-hard combinatorial optimization problem of partitioning a real-valued edge-weighted graph such as to minimize the total cost of the partition. While graph convolutional neural networks…

机器学习 · 计算机科学 2022-04-05 Steffen Jung , Margret Keuper