English
Related papers

Related papers: Sliding Window Sum Algorithms for Deep Neural Netw…

200 papers

Semantic embeddings to represent objects such as image, text and audio are widely used in machine learning and have spurred the development of vector similarity search methods for retrieving semantically related objects. In this work, we…

Data Structures and Algorithms · Computer Science 2026-01-21 Stephen Mussmann , Mehul Smriti Raje , Kavya Tumkur , Oumayma Messoussi , Cyprien Hachem , Seby Jacob

Depthwise separable convolutions reduce the number of parameters and computation used in convolutional operations while increasing representational efficiency. They have been shown to be successful in image classification models, both in…

Computation and Language · Computer Science 2017-06-19 Lukasz Kaiser , Aidan N. Gomez , Francois Chollet

The need for consistent treatment of uncertainty has recently triggered increased interest in probabilistic deep learning methods. However, most current approaches have severe limitations when it comes to inference, since many of these…

The availability of large number of processing nodes in a parallel and distributed computing environment enables sophisticated real time processing over high speed data streams, as required by many emerging applications. Sliding window…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-07-26 Abhirup Chakraborty , Ajit Singh

In this paper, we present a simple yet effective padding scheme that can be used as a drop-in module for existing convolutional neural networks. We call it partial convolution based padding, with the intuition that the padded region can be…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Guilin Liu , Kevin J. Shih , Ting-Chun Wang , Fitsum A. Reda , Karan Sapra , Zhiding Yu , Andrew Tao , Bryan Catanzaro

This work presents and analyzes three convolutional neural network (CNN) models for efficient pixelwise classification of images. When using convolutional neural networks to classify single pixels in patches of a whole image, a lot of…

Computer Vision and Pattern Recognition · Computer Science 2015-09-14 Fabian Tschopp

Sum-Product Networks (SPNs) are hierarchical, graphical models that combine benefits of deep learning and probabilistic modeling. SPNs offer unique advantages to applications demanding exact probabilistic inference over high-dimensional,…

Machine Learning · Computer Science 2020-09-24 Jos van de Wolfshaar , Andrzej Pronobis

Algorithms are developed for calculating dealiased linear convolution sums without the expense of conventional zero-padding or phase-shift techniques. For one-dimensional in-place convolutions, the memory requirements are identical with the…

Computational Engineering, Finance, and Science · Computer Science 2011-02-14 John C. Bowman , Malcolm Roberts

Deep neural networks have recently achieved state of the art performance thanks to new training algorithms for rapid parameter estimation and new regularization methods to reduce overfitting. However, in practice the network architecture…

Machine Learning · Computer Science 2016-03-04 Minyoung Kim , Luca Rigazio

The prefix sum operation is a useful primitive with a broad range of applications. For database systems, it is a building block of many important operators including join, sort and filter queries. In this paper, we study different methods…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-25 Wangda Zhang , Yanbin Wang , Kenneth A. Ross

Recommendation algorithms that incorporate techniques from deep learning are becoming increasingly popular. Due to the structure of the data coming from recommendation domains (i.e., one-hot-encoded vectors of item preferences), these…

Machine Learning · Computer Science 2017-06-14 Joan Serrà , Alexandros Karatzoglou

Calculating the correlation in a sliding window is a common method of statistical evaluation of the interconnect between two sets of data. And although the calculation of a single correlation coefficient is not resource-intensive and…

Data Structures and Algorithms · Computer Science 2018-07-18 Alexey Poyda , Mikhail Zhizhin

The support vector clustering algorithm is a well-known clustering algorithm based on support vector machines using Gaussian or polynomial kernels. The classical support vector clustering algorithm works well in general, but its performance…

Machine Learning · Computer Science 2020-05-27 Arit Kumar Bishwas , Ashish Mani , Vasile Palade

Subset Sum is a classical optimization problem taught to undergraduates as an example of an NP-hard problem, which is amenable to dynamic programming, yielding polynomial running time if the input numbers are relatively small. Formally,…

Data Structures and Algorithms · Computer Science 2018-07-24 Konstantinos Koiliaris , Chao Xu

We seek to improve deep neural networks by generalizing the pooling operations that play a central role in current architectures. We pursue a careful exploration of approaches to allow pooling to learn and to adapt to complex and variable…

Machine Learning · Statistics 2015-10-13 Chen-Yu Lee , Patrick W. Gallagher , Zhuowen Tu

High dimension low sample size statistical analysis is important in a wide range of applications. In such situations, the highly appealing discrimination method, support vector machine, can be improved to alleviate data piling at the…

Optimization and Control · Mathematics 2017-08-18 Xin Yee Lam , J. S. Marron , Defeng Sun , Kim-Chuan Toh

The sliding window model generalizes the standard streaming model and often performs better in applications where recent data is more important or more accurate than data that arrived prior to a certain time. We study the problem of…

Data Structures and Algorithms · Computer Science 2021-09-06 Vladimir Braverman , Viska Wei , Samson Zhou

Many classical algorithms are known for computing the convex hull of a set of $n$ point in $\mathbb{R}^2$ using $O(n)$ space. For large point sets, whose size exceeds the size of the working space, these algorithms cannot be directly used.…

Computational Geometry · Computer Science 2018-10-02 Martin Farach-Colton , Meng Li , Meng-Tsung Tsai

Convolutional graph networks are used in particle physics for effective event reconstructions and classifications. However, their performances can be limited by the considerable amount of sensors used in modern particle detectors if applied…

High Energy Physics - Experiment · Physics 2022-10-10 M. Bachlechner , T. Birkenfeld , P. Soldin , A. Stahl , C. Wiebusch

Depth-wise pruning accelerates LLM inference in resource-constrained scenarios but suffers from performance degradation due to direct removal of entire Transformer layers. This paper reveals ``Patch-like'' redundancy across layers via…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Xuan Ding , Rui Sun , Yunjian Zhang , Xiu Yan , Yueqi Zhou , Kaihao Huang , Suzhong Fu , Angelica I Aviles-Rivero , Chuanlong Xie , Yao Zhu