English
Related papers

Related papers: Efficient Dealiased Convolutions without Padding

200 papers

We introduce the Fast Free Memory method (FFM), a new fast method for the numerical evaluation of convolution products. Inheriting from the Fast Multipole Method, the FFM is a descent-only and kernel-independent algorithm. We give the…

Numerical Analysis · Mathematics 2019-09-13 Matthieu Aussal , Marc Bakry

Convolutional neural networks are state-of-the-art for various segmentation tasks. While for 2D images these networks are also computationally efficient, 3D convolutions have huge storage requirements and therefore, end-to-end training is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Christoph Angermann , Markus Haltmeier

Data dimensionality reduction in radio interferometry can provide savings of computational resources for image reconstruction through reduced memory footprints and lighter computations per iteration, which is important for the scalability…

Instrumentation and Methods for Astrophysics · Physics 2017-05-03 S. Vijay Kartik , Rafael E. Carrillo , Jean-Philippe Thiran , Yves Wiaux

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

In this paper, we give a number of new exact algorithms and heuristics to compute linear boolean decompositions, and experimentally evaluate these algorithms. The experimental evaluation shows that significant improvements can be made with…

Computational Complexity · Computer Science 2015-09-28 Chiel B. Ten Brinke , Frank J. P. van Houten , Hans L. Bodlaender

Some conventional transforms such as Discrete Walsh-Hadamard Transform (DWHT) and Discrete Cosine Transform (DCT) have been widely used as feature extractors in image processing but rarely applied in neural networks. However, we found that…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Joonhyun Jeong , Sung-Ho Bae

We present an efficient, trivially parallelizable algorithm to compute offset surfaces of shapes discretized using a dexel data structure. Our algorithm is based on a two-stage sweeping procedure that is simple to implement and efficient,…

Graphics · Computer Science 2019-04-10 Zhen Chen , Daniele Panozzo , Jeremie Dumas

We propose a decomposition framework for the parallel optimization of the sum of a differentiable function and a (block) separable nonsmooth, convex one. The latter term is typically used to enforce structure in the solution as, for…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-12 Francisco Facchinei , Simone Sagratella , Gesualdo Scutari

Also recently, exciting strides forward have been made in the area of image restoration, particularly for image denoising and single image super-resolution. Deep learning techniques contributed to this significantly. The top methods differ…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Jiqing Wu , Radu Timofte , Luc Van Gool

Modern inference and learning often hinge on identifying low-dimensional structures that approximate large scale data. Subspace clustering achieves this through a union of linear subspaces. However, in contemporary applications data is…

Machine Learning · Computer Science 2018-08-03 Daniel L. Pimentel-Alarcón , Usman Mahmood

We prove that every flat nonlinear discrete-time system can be decomposed by coordinate transformations into a smaller-dimensional subsystem and an endogenous dynamic feedback. For flat continuous-time systems, no comparable result is…

Optimization and Control · Mathematics 2021-07-28 Bernd Kolar , Markus Schöberl , Johannes Diwold

Like other applications in computer vision, medical image segmentation has been most successfully addressed using deep learning models that rely on the convolution operation as their main building block. Convolutions enjoy important…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Davood Karimi , Serge Vasylechko , Ali Gholipour

The great advances of learning-based approaches in image processing and computer vision are largely based on deeply nested networks that compose linear transfer functions with suitable non-linearities. Interestingly, the most frequently…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Peter Ochs , Tim Meinhardt , Laura Leal-Taixe , Michael Moeller

We present a super-high-efficiency approximate computing scheme for series sum and discrete Fourier transform. The summation of a series sum or a discrete Fourier transform is approximated by summing over part of the terms multiplied by…

Numerical Analysis · Mathematics 2013-12-09 Xin-Zhong Yan

While widespread, Transformers lack inductive biases for geometric symmetries common in science and computer vision. Existing equivariant methods often sacrifice the efficiency and flexibility that make Transformers so effective through…

We develop and analyze an asynchronous algorithm for distributed convex optimization when the objective writes a sum of smooth functions, local to each worker, and a non-smooth function. Unlike many existing methods, our distributed…

Optimization and Control · Mathematics 2019-12-13 Konstantin Mishchenko , Franck Iutzeler , Jérôme Malick

Convolutional neural networks have recently been used for multi-focus image fusion. However, due to the lack of labeled data for supervised training of such networks, existing methods have resorted to adding Gaussian blur in focused images…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Xiang Yan , Syed Zulqarnain Gilani , Hanlin Qin , Ajmal Mian

Where dealing with temporal sequences it is fair to assume that the same kind of deformations that motivated the development of the Dynamic Time Warp algorithm could be relevant also in the calculation of the dot product ("convolution") in…

Machine Learning · Computer Science 2019-11-06 Yaniv Shulman

We propose an efficient quantum algorithm for simulating the dynamics of general Hamiltonian systems. Our technique is based on a power series expansion of the time-evolution operator in its off-diagonal terms. The expansion decouples the…

Quantum Physics · Physics 2021-06-22 Amir Kalev , Itay Hen

In image deconvolution problems, the diagonalization of the underlying operators by means of the FFT usually yields very large speedups. When there are incomplete observations (e.g., in the case of unknown boundaries), standard…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Miguel Simões , Luis B. Almeida , José Bioucas-Dias , Jocelyn Chanussot