English
Related papers

Related papers: Learning Local Feature Aggregation Functions with …

200 papers

Image search systems based on local descriptors typically achieve orientation invariance by aligning the patches on their dominant orientations. Albeit successful, this choice introduces too much invariance because it does not guarantee…

Computer Vision and Pattern Recognition · Computer Science 2014-11-26 Giorgos Tolias , Teddy Furon , Hervé Jégou

We propose a novel adaptive approximation approach for test-time resource-constrained prediction. Given an input instance at test-time, a gating function identifies a prediction model for the input among a collection of models. Our…

Machine Learning · Statistics 2017-05-30 Feng Nan , Venkatesh Saligrama

While backpropagation--reverse-mode automatic differentiation--has been extraordinarily successful in deep learning, it requires two passes (forward and backward) through the neural network and the storage of intermediate activations.…

Machine Learning · Computer Science 2025-11-06 Daniel Wang , Evan Markou , Dylan Campbell

The paper contributes to strengthening the relation between machine learning and the theory of differential equations. In this context, the inverse problem of fitting the parameters, and the initial condition of a differential equation to…

Machine Learning · Computer Science 2022-06-22 Imre Fekete , András Molnár , Péter L. Simon

This paper presents a locally decoupled network parameter learning with local propagation. Three elements are taken into account: (i) sets of nonlinear transforms that describe the representations at all nodes, (ii) a local objective at…

Machine Learning · Computer Science 2018-05-22 Dimche Kostadinov , Behrooz Razeghi , Sohrab Ferdowsi , Slava Voloshynovskiy

Even though the computation of local properties, such as densities or radial distribution functions, remains one of the most standard goals of molecular simulation, it still largely relies on straighforward histogram-based strategies. Here…

Computational Physics · Physics 2020-10-28 Benjamin Rotenberg

To infer the parameters of mechanistic models with intractable likelihoods, techniques such as approximate Bayesian computation (ABC) are increasingly being adopted. One of the main disadvantages of ABC in practical situations, however, is…

Computation · Statistics 2018-08-03 Jonathan U Harrison , Ruth E Baker

We focus on autonomously generating robot motion for day to day physical tasks that is expressive of a certain style or emotion. Because we seek generalization across task instances and task types, we propose to capture style via cost…

Robotics · Computer Science 2018-09-05 Allan Zhou , Anca D. Dragan

We address the problem of learning on sets of features, motivated by the need of performing pooling operations in long biological sequences of varying sizes, with long-range dependencies, and possibly few labeled data. To address this…

Machine Learning · Computer Science 2021-02-11 Grégoire Mialon , Dexiong Chen , Alexandre d'Aspremont , Julien Mairal

The challenge in few-shot learning is that available data is not enough to capture the underlying distribution. To mitigate this, two emerging directions are (a) using local image representations, essentially multiplying the amount of data…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

Optimization and Control · Mathematics 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

Fine-tuning large language models requires high computational and memory resources, and is therefore associated with significant costs. When training on federated datasets, an increased communication effort is also needed. For this reason,…

Machine Learning · Computer Science 2026-05-06 Evelyn Trautmann , Ian Hales , Martin F. Volk

One-stage object detectors are trained by optimizing classification-loss and localization-loss simultaneously, with the former suffering much from extreme foreground-background class imbalance issue due to the large number of anchors. This…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Kean Chen , Weiyao Lin , Jianguo Li , John See , Ji Wang , Junni Zou

Human pose estimation plays an important role in many computer vision tasks and has been studied for many decades. However, due to complex appearance variations from poses, illuminations, occlusions and low resolutions, it still remains a…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Zhihui Su , Ming Ye , Guohui Zhang , Lei Dai , Jianda Sheng

In this paper, we propose a new framework for segmenting feature-based moving objects under affine subspace model. Since the feature trajectories in practice are high-dimensional and contain a lot of noise, we firstly apply the sparse PCA…

Computer Vision and Pattern Recognition · Computer Science 2017-01-25 Michael Ying Yang , Hanno Ackermann , Weiyao Lin , Sitong Feng , Bodo Rosenhahn

Backpropagation is a classic automatic differentiation algorithm computing the gradient of functions specified by a certain class of simple, first-order programs, called computational graphs. It is a fundamental tool in several fields, most…

Logic in Computer Science · Computer Science 2019-11-07 Alois Brunel , Damiano Mazza , Michele Pagani

Unsupervised approaches to learning in neural networks are of substantial interest for furthering artificial intelligence, both because they would enable the training of networks without the need for large numbers of expensive annotations,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Chengxu Zhuang , Alex Lin Zhai , Daniel Yamins

We marry ideas from deep neural networks and approximate Bayesian inference to derive a generalised class of deep, directed generative models, endowed with a new algorithm for scalable inference and learning. Our algorithm introduces a…

Machine Learning · Statistics 2014-06-02 Danilo Jimenez Rezende , Shakir Mohamed , Daan Wierstra

We present some new density estimation algorithms obtained by bootstrap aggregation like Bagging. Our algorithms are analyzed and empirically compared to other methods found in the statistical literature, like stacking and boosting for…

Methodology · Statistics 2012-07-23 Mathias Bourel , Badih Ghattas

In this paper, a new learning algorithm for Federated Learning (FL) is introduced. The proposed scheme is based on a weighted gradient aggregation using two-step optimization to offer a flexible training pipeline. Herein, two different…

Machine Learning · Computer Science 2021-06-15 Dimitrios Dimitriadis , Kenichi Kumatani , Robert Gmyr , Yashesh Gaur , Sefik Emre Eskimez