English
Related papers

Related papers: Minimal Filtering Algorithms for Convolutional Neu…

200 papers

To build the connectomics map of the brain, we developed a new algorithm that can automatically refine the Membrane Detection Probability Maps (MDPM) generated to perform automatic segmentation of electron microscopy (EM) images. To achieve…

Neural and Evolutionary Computing · Computer Science 2015-06-22 Xundong Wu

Acceleration of convolutional neural network has received increasing attention during the past several years. Among various acceleration techniques, filter pruning has its inherent merit by effectively reducing the number of convolution…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Dong Wang , Lei Zhou , Xiao Bai , Jun Zhou

We present a randomized $O(m \log^2 n)$ work, $O(\text{polylog } n)$ depth parallel algorithm for minimum cut. This algorithm matches the work bounds of a recent sequential algorithm by Gawrychowski, Mozes, and Weimann [ICALP'20], and…

Data Structures and Algorithms · Computer Science 2021-12-30 Daniel Anderson , Guy E. Blelloch

In the noisy primitives model, each primitive comparison performed by an algorithm, e.g., testing whether one value is greater than another, returns the incorrect answer with random, independent probability p < 1/2 and otherwise returns a…

Computational Geometry · Computer Science 2026-02-13 Michael T. Goodrich , Vinesh Sridhar

The convex hull is a fundamental geometrical structure for many applications where groups of points must be enclosed or represented by a convex polygon. Although efficient sequential convex hull algorithms exist, and are constantly being…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-27 Alan Keith , Héctor Ferrada , Cristóbal A. Navarro

This paper presents near-optimal deterministic parallel and distributed algorithms for computing $(1+\varepsilon)$-approximate single-source shortest paths in any undirected weighted graph. On a high level, we deterministically reduce this…

Data Structures and Algorithms · Computer Science 2022-09-26 Václav Rozhoň , Christoph Grunau , Bernhard Haeupler , Goran Zuzic , Jason Li

Backpropagation algorithm is indispensable for the training of feedforward neural networks. It requires propagating error gradients sequentially from the output layer all the way back to the input layer. The backward locking in…

Machine Learning · Computer Science 2018-07-24 Zhouyuan Huo , Bin Gu , Qian Yang , Heng Huang

We present data structures and algorithms for native implementations of discrete convolution operators over Adaptive Particle Representations (APR) of images on parallel computer architectures. The APR is a content-adaptive image…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Joel Jonsson , Bevan L. Cheeseman , Suryanarayana Maddu , Krzysztof Gonciarz , Ivo F. Sbalzarini

Hardware accelerators for convolution neural networks (CNNs) enable real-time applications of artificial intelligence technology. However, most of the existing designs suffer from low hardware utilization or high area cost due to complex…

Hardware Architecture · Computer Science 2022-05-06 Kuo-Wei Chang , Tian-Sheuan Chang

A well-trained Convolutional Neural Network can easily be pruned without significant loss of performance. This is because of unnecessary overlap in the features captured by the network's filters. Innovations in network architecture such as…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Aaditya Prakash , James Storer , Dinei Florencio , Cha Zhang

The Massive Parallel Computation (MPC) model is a theoretical framework for popular parallel and distributed platforms such as MapReduce, Hadoop, or Spark. We consider the task of computing a large matching or small vertex cover in this…

Data Structures and Algorithms · Computer Science 2018-07-24 Krzysztof Onak

In convolutional neural networks (CNNs), the filter grouping in convolution layers is known to be useful to reduce the network parameter size. In this paper, we propose a new logarithmic filter grouping which can capture the nonlinearity of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Tae Kwan Lee , Wissam J. Baddar , Seong Tae Kim , Yong Man Ro

Convolutional Neural Networks (CNNs) filter the input data using a series of spatial convolution operators with compactly supported stencils and point-wise nonlinearities. Commonly, the convolution operators couple features from all…

Numerical Analysis · Computer Science 2018-10-04 Eran Treister , Lars Ruthotto , Michal Sharoni , Sapir Zafrani , Eldad Haber

Nowadays, it is still difficult to adapt Convolutional Neural Network (CNN) based models for deployment on embedded devices. The heavy computation and large memory footprint of CNN models become the main burden in real application. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Xin Li , Changsong Liu

This paper analyzes the effects of approximate multiplication when performing inferences on deep convolutional neural networks (CNNs). The approximate multiplication can reduce the cost of the underlying circuits so that CNN inferences can…

Machine Learning · Computer Science 2021-01-12 Min Soo Kim , Alberto A. Del Barrio , HyunJin Kim , Nader Bagherzadeh

During the last years, algorithms known as Convolutional Neural Networks (CNNs) had become increasingly popular, expanding its application range to several areas. In particular, the image processing field has experienced a remarkable…

Hardware Architecture · Computer Science 2024-08-27 Federico Nicolas Peccia , Luciano Ferreyro , Alejandro Furfaro

The reconfigurability, energy-efficiency, and massive parallelism on FPGAs make them one of the best choices for implementing efficient deep learning accelerators. However, state-of-art implementations seldom consider the balance between…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-05 Feng Shi , Haochen Li , Yuhe Gao , Benjamin Kuschner , Song-Chun Zhu

Sequential Monte Carlo techniques are useful for state estimation in non-linear, non-Gaussian dynamic models. These methods allow us to approximate the joint posterior distribution using sequential importance sampling. In this framework,…

Computation · Statistics 2012-07-09 Mike Klaas , Nando de Freitas , Arnaud Doucet

For $n$-vertex $m$-edge graphs with integer polynomially-bounded costs and capacities, we provide a randomized parallel algorithm for the minimum cost flow problem with $\tilde O(m+n^ {1.5})$ work and $\tilde O(\sqrt{n})$ depth. On…

Data Structures and Algorithms · Computer Science 2025-03-18 Jan van den Brand , Hossein Gholizadeh , Yonggang Jiang , Tijn de Vos

Sliding window sums are widely used for string indexing, hashing and time series analysis. We have developed a family of the generic vectorized sliding sum algorithms that provide speedup of O(P/w) for window size $w$ and number of…

Machine Learning · Computer Science 2023-05-29 Roman Snytsar