English
Related papers

Related papers: Poly-NL: Linear Complexity Non-local Layers with P…

200 papers

When faced with learning a set of inter-related tasks from a limited amount of usable data, learning each task independently may lead to poor generalization performance. Multi-Task Learning (MTL) exploits the latent relations between tasks…

Machine Learning · Computer Science 2015-08-14 Niloofar Yousefi , Michael Georgiopoulos , Georgios C. Anagnostopoulos

A long-standing challenge in coreference resolution has been the incorporation of entity-level information - features defined over clusters of mentions instead of mention pairs. We present a neural network based coreference system that…

Computation and Language · Computer Science 2016-06-10 Kevin Clark , Christopher D. Manning

Convolutional Neural Networks (CNN) possess many positive qualities when it comes to spatial raster data. Translation invariance enables CNNs to detect features regardless of their position in the scene. However, in some domains, like…

Machine Learning · Computer Science 2020-07-13 Arnas Uselis , Mantas Lukoševičius , Lukas Stasytis

We present Locally Orderless Networks (LON) and its theoretic foundation which links it to Convolutional Neural Networks (CNN), to Scale-space histograms, and measurement theory. The key elements are a regular sampling of the bias and the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Jon Sporring , Peidi Xu , Jiahao Lu , François Lauze , Sune Darkner

The non-local module works as a particularly useful technique for semantic segmentation while criticized for its prohibitive computation and GPU memory occupation. In this paper, we present Asymmetric Non-local Neural Network to semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Zhen Zhu , Mengde Xu , Song Bai , Tengteng Huang , Xiang Bai

Traditional 3D Convolutional Neural Networks (CNNs) are computationally expensive, memory intensive, prone to overfit, and most importantly, there is a need to improve their feature learning capabilities. To address these issues, we propose…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Sudhakar Kumawat , Shanmuganathan Raman

Recent trends of incorporating attention mechanisms in vision have led researchers to reconsider the supremacy of convolutional layers as a primary building block. Beyond helping CNNs to handle long-range dependencies, Ramachandran et al.…

Machine Learning · Computer Science 2020-01-13 Jean-Baptiste Cordonnier , Andreas Loukas , Martin Jaggi

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

Existing fast algorithms for bilateral and nonlocal means filtering mostly work with grayscale images. They cannot easily be extended to high-dimensional data such as color and hyperspectral images, patch-based data, flow-fields, etc. In…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Pravin Nair , Kunal. N. Chaudhury

We address the challenge of applying existing convolutional neural network (CNN) architectures to compressed images. Existing CNN architectures represent images as a matrix of pixel intensities with a specified dimension; this desired…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Christopher A. George , Bradley M. West

Inhomogeneities in real-world data, e.g., due to changes in the observation noise level or variations in the structural complexity of the source function, pose a unique set of challenges for statistical inference. Accounting for them can…

Machine Learning · Computer Science 2023-12-13 Danny Panknin , Stefan Chmiela , Klaus-Robert Müller , Shinichi Nakajima

Methods that combine local and global features have recently shown excellent performance on multiple challenging deep image retrieval benchmarks, but their use of local features raises at least two issues. First, these local features simply…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Philippe Weinzaepfel , Thomas Lucas , Diane Larlus , Yannis Kalantidis

The use of machine learning techniques to improve the performance of branch-and-bound optimization algorithms is a very active area in the context of mixed integer linear problems, but little has been done for non-linear optimization. To…

Joint object matching, also known as multi-image matching, namely, the problem of finding consistent partial maps among all pairs of objects within a collection, is a crucial task in many areas of computer vision. This problem subsumes…

Optimization and Control · Mathematics 2022-11-29 Antonio De Rosa , Aida Khajavirad

A nonlocal perfectly matched layer (PML) is formulated for the nonlocal wave equation in the whole real axis and numerical discretization is designed for solving the reduced PML problem on a bounded domain. The nonlocal PML poses challenges…

Numerical Analysis · Mathematics 2022-02-22 Yu Du , Jiwei Zhang

The focus of this paper is speeding up the evaluation of convolutional neural networks. While delivering impressive results across a range of computer vision and machine learning tasks, these networks are computationally demanding, limiting…

Computer Vision and Pattern Recognition · Computer Science 2014-05-16 Max Jaderberg , Andrea Vedaldi , Andrew Zisserman

Our goal is to design architectures that retain the groundbreaking performance of CNNs for landmark localization and at the same time are lightweight, compact and suitable for applications with limited computational resources. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Adrian Bulat , Georgios Tzimiropoulos

It was recently demonstrated [J. Electron. Imaging, 25(2), 2016] that one can perform fast non-local means (NLM) denoising of one-dimensional signals using a method called lifting. The cost of lifting is independent of the patch length,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Sanjay Ghosh , Kunal N. Chaudhury

This paper proposed a new explicit nonlinear dimensionality reduction using neural networks for image retrieval tasks. We first proposed a Quasi-curvature Locally Linear Embedding (QLLE) for training set. QLLE guarantees the linear…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Shenglan Liu , Jun Wu , Lin Feng , Feilong Wang

We introduce a methodology for analyzing neural networks through the lens of layer-wise Hessian matrices. The local Hessian of each functional block (layer) is defined as the matrix of second derivatives of a scalar function with respect to…

Machine Learning · Computer Science 2025-11-11 Maxim Bolshim , Alexander Kugaevskikh