English
Related papers

Related papers: Learning Smooth Distance Functions via Queries

200 papers

Distances are pervasive in machine learning. They serve as similarity measures, loss functions, and learning targets; it is said that a good distance measure solves a task. When defining distances, the triangle inequality has proven to be a…

Machine Learning · Computer Science 2020-07-08 Silviu Pitis , Harris Chan , Kiarash Jamali , Jimmy Ba

Modern image retrieval systems increasingly rely on the use of deep neural networks to learn embedding spaces in which distance encodes the relevance between a given query and image. In this setting, existing approaches tend to emphasize…

Machine Learning · Computer Science 2020-11-18 Andreas Veit , Kimberly Wilber

The manifold hypothesis (real world data concentrates near low-dimensional manifolds) is suggested as the principle behind the effectiveness of machine learning algorithms in very high dimensional problems that are common in domains such as…

Machine Learning · Computer Science 2022-07-15 Aditya Chetan , Nipun Kwatra

We study the problem of approximating the level set of an unknown function by sequentially querying its values. We introduce a family of algorithms called Bisect and Approximate through which we reduce the level set approximation problem to…

Statistics Theory · Mathematics 2021-02-24 François Bachoc , Tommaso Cesari , Sébastien Gerchinovitz

We study approximation of functions by algebraic polynomials in the H\"older spaces corresponding to the generalized Jacobi translation and the Ditzian-Totik moduli of smoothness. By using modifications of the classical moduli of…

Classical Analysis and ODEs · Mathematics 2016-02-17 Yurii Kolomoitsev , Tetiana Lomako , Jürgen Prestin

In this paper we discuss approximation of partially smooth functions. The problem arises naturally in the study of laminated currents.

Dynamical Systems · Mathematics 2015-06-26 John Fornaess , Yinxia Wang , Erlend Fornaess Wold

We study the problem of supervised learning a metric space under discriminative constraints. Given a universe $X$ and sets ${\cal S}, {\cal D}\subset {X \choose 2}$ of similar and dissimilar pairs, we seek to find a mapping $f:X\to Y$, into…

Computational Geometry · Computer Science 2019-03-20 Diego Ihara Centurion , Neshat Mohammadi , Anastasios Sidiropoulos

Existing deep embedding methods in vision tasks are capable of learning a compact Euclidean space from images, where Euclidean distances correspond to a similarity metric. To make learning more effective and efficient, hard sample mining is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-28 Chen Huang , Chen Change Loy , Xiaoou Tang

Human-centered environments are rich with a wide variety of spatial relations between everyday objects. For autonomous robots to operate effectively in such environments, they should be able to reason about these relations and generalize…

Robotics · Computer Science 2017-07-25 Oier Mees , Nichola Abdo , Mladen Mazuran , Wolfram Burgard

We propose a novel iterative process to establish the minimum separation between two ellipsoids. The method maintains one point on each surface and updates their locations in the theta-phi parametric space. The tension along the connecting…

Computational Geometry · Computer Science 2026-03-25 Dariush Amirkhani , Junfeng Zhang

This paper describes the formulation and experimental testing of a novel method for the estimation and approximation of submanifold models of animal motion. It is assumed that the animal motion is supported on a configuration manifold $Q$…

Machine Learning · Statistics 2021-05-26 Nathan Powell , Andrew Kurdila

The main contribution of this dissertation is the introduction of new or improved approximation algorithms and data structures for several similarity search problems. We examine the furthest neighbor query, the annulus query, distance…

Data Structures and Algorithms · Computer Science 2019-06-13 Johan von Tangen Sivertsen

Multiplication layers are a key component in various influential neural network modules, including self-attention and hypernetwork layers. In this paper, we investigate the approximation capabilities of deep neural networks with…

Machine Learning · Computer Science 2023-01-12 Ido Ben-Shaul , Tomer Galanti , Shai Dekel

In this contribution, we augment the metric learning setting by introducing a parametric pseudo-distance, trained jointly with the encoder. Several interpretations are thus drawn for the learned distance-like model's output. We first show…

Machine Learning · Computer Science 2020-08-17 Joao Monteiro , Isabela Albuquerque , Jahangir Alam , R Devon Hjelm , Tiago Falk

A central problem in machine learning is often formulated as follows: Given a dataset $\{(x_j, y_j)\}_{j=1}^M$, which is a sample drawn from an unknown probability distribution, the goal is to construct a functional model $f$ such that…

Machine Learning · Computer Science 2026-03-05 Hrushikesh N. Mhaskar , Efstratios Tsoukanis , Ameya D. Jagtap

We study the complexity of smoothed agnostic learning, recently introduced by~\cite{CKKMS24}, in which the learner competes with the best classifier in a target class under slight Gaussian perturbations of the inputs. Specifically, we focus…

Machine Learning · Computer Science 2026-02-25 Ilias Diakonikolas , Daniel M. Kane

In the paper we consider the problem of multivariate function approximation in polynomial basis. In order to solve this problem, we adjust the least squares method (LSM) by adding information about derivatives of the function. This…

Numerical Analysis · Mathematics 2018-02-06 Gleb Ryzhakov , Ivan Oseledets

Computing the Fr\'{e}chet distance for surfaces is a surprisingly hard problem and the only known algorithm is limited to computing it between flat surfaces. We adapt this algorithm to create one for computing the Fr\'{e}chet distance for a…

Computational Geometry · Computer Science 2011-03-16 Atlas F. Cook , Anne Driemel , Sariel Har-Peled , Jessica Sherette , Carola Wenk

We study the problem of learning hypergraphs with shortest-path queries (SP-queries), and present the first provably optimal online algorithm for a broad and natural class of hypertrees that we call orderly hypertrees. Our online algorithm…

Machine Learning · Computer Science 2025-12-01 Shaun Fallat , Kamyar Khodamoradi , David Kirkpatrick , Valerii Maliuk , S. Ahmad Mojallal , Sandra Zilles

Observing a human demonstrator manipulate objects provides a rich, scalable and inexpensive source of data for learning robotic policies. However, transferring skills from human videos to a robotic manipulator poses several challenges, not…

Robotics · Computer Science 2023-03-08 Minttu Alakuijala , Gabriel Dulac-Arnold , Julien Mairal , Jean Ponce , Cordelia Schmid