English
Related papers

Related papers: Path Planning with Divergence-Based Distance Funct…

200 papers

In this paper, we revisit the old problem of compact finite difference approximations of the homogeneous Dirichlet problem in dimension 1. We design a large and natural set of schemes of arbitrary high order, and we equip this set with an…

Numerical Analysis · Mathematics 2017-10-10 Joackim Bernier

Divergences are quantities that measure discrepancy between two probability distributions and play an important role in various fields such as statistics and machine learning. Divergences are non-negative and are equal to zero if and only…

Statistics Theory · Mathematics 2019-10-22 Tomohiro Nishiyama

We propose a family of recursive cutting-plane algorithms to solve feasibility problems with constrained memory, which can also be used for first-order convex optimization. Precisely, in order to find a point within a ball of radius…

Optimization and Control · Mathematics 2023-06-21 Moïse Blanchard , Junhui Zhang , Patrick Jaillet

Density-based directed distances -- particularly known as divergences -- between probability distributions are widely used in statistics as well as in the adjacent research fields of information theory, artificial intelligence and machine…

Statistics Theory · Mathematics 2022-03-03 Michel Broniatowski , Wolfgang Stummer

The recent years have witnessed advances in parallel algorithms for large scale optimization problems. Notwithstanding demonstrated success, existing algorithms that parallelize over features are usually limited by divergence issues under…

Machine Learning · Computer Science 2017-12-08 An Bian , Xiong Li , Yuncai Liu , Ming-Hsuan Yang

In this work, we propose efficient and accurate numerical algorithms based on Difference Potentials Method for numerical solution of chemotaxis systems and related models in 3D. The developed algorithms handle 3D irregular geometry with the…

Numerical Analysis · Mathematics 2019-02-12 Yekaterina Epshteyn , Qing Xia

This paper provides a block coordinate descent algorithm to solve unconstrained optimization problems. In our algorithm, computation of function values or gradients is not required. Instead, pairwise comparison of function values is used.…

Machine Learning · Statistics 2014-09-16 Kota Matsui , Wataru Kumagai , Takafumi Kanamori

Computing the reachability probability in infinite state probabilistic models has been the topic of numerous works. Here we introduce a new property called \emph{divergence} that when satisfied allows to compute reachability probabilities…

Formal Languages and Automata Theory · Computer Science 2026-03-03 Alain Finkel , Serge Haddad , Lina Ye

While much progress has been achieved over the last decades in neuro-inspired machine learning, there are still fundamental theoretical problems in gradient-based learning using combinations of neurons. These problems, such as saddle points…

Machine Learning · Computer Science 2023-06-16 Winfried Lohmiller , Philipp Gassert , Jean-Jacques Slotine

A function approximation method is developed that aims to approximate a function in a small neighborhood of a state that travels within a compact set. The development is based on the theory of universal reproducing kernel Hilbert spaces…

Optimization and Control · Mathematics 2021-07-07 Joel A. Rosenfeld , Rushikesh Kamalapurkar , Warren E. Dixon

We present a unified technique for sequential estimation of convex divergences between distributions, including integral probability metrics like the kernel maximum mean discrepancy, $\varphi$-divergences like the Kullback-Leibler…

Statistics Theory · Mathematics 2023-03-14 Tudor Manole , Aaditya Ramdas

The convergence theory for the gradient sampling algorithm is extended to directionally Lipschitz functions. Although directionally Lipschitz functions are not necessarily locally Lipschitz, they are almost everywhere differentiable and…

Optimization and Control · Mathematics 2021-07-13 James V. Burke , Qiuying Lin

We design a Quasi-Polynomial time deterministic approximation algorithm for computing the integral of a multi-dimensional separable function, supported by some underlying hyper-graph structure, appropriately defined. Equivalently, our…

Data Structures and Algorithms · Computer Science 2024-02-14 David Gamarnik , Devin Smedira

Given a bounded domain, we deal with the problem of estimating the distance function from the internal points of the domain to the boundary of the domain. Convolutional and differential distance estimation schemes are considered and, for…

Numerical Analysis · Mathematics 2024-12-13 Alexander Belyaev , Pierre-Alain Fayolle

When planning motions in a configuration space that has underlying symmetries (e.g. when manipulating one or multiple symmetric objects), the ideal planning algorithm should take advantage of those symmetries to produce shorter…

Robotics · Computer Science 2025-07-18 Thomas Cohn , Russ Tedrake

This paper presents a method for the approximation of harmonic potentials that combines downward continuation of globally available data on a sphere $\Omega_R$ of radius $R$ (e.g., a satellite's orbit) with locally available data on a…

Numerical Analysis · Mathematics 2015-07-07 Christian Gerhards

The Distance Geometry Problem (DGP) seeks to find positions for a set of points in geometric space when some distances between pairs of these points are known. The so-called discretization assumptions allow to discretize the search space of…

Optimization and Control · Mathematics 2021-07-02 Moira MacNeil , Merve Bodur

This paper proposes the divergence triangle as a framework for joint training of generator model, energy-based model and inference model. The divergence triangle is a compact and symmetric (anti-symmetric) objective function that seamlessly…

Machine Learning · Statistics 2019-02-01 Tian Han , Erik Nijkamp , Xiaolin Fang , Mitch Hill , Song-Chun Zhu , Ying Nian Wu

This book deals with functions allowing to express the dissimilarity (discrepancy) between two data fields or ''divergence functions'' with the aim of applications to linear inverse problems. Most of the divergences found in the litterature…

Optimization and Control · Mathematics 2020-03-04 Henri Lantéri

We present a novel approach to differential cost analysis that, given a program revision, attempts to statically bound the difference in resource usage, or cost, between the two program versions. Differential cost analysis is particularly…

Programming Languages · Computer Science 2022-04-08 Đorđe Žikelić , Bor-Yuh Evan Chang , Pauline Bolignano , Franco Raimondi