English
Related papers

Related papers: Linear programming problems for l_1- optimal front…

200 papers

Typical behavior of the linear programming (LP) problem is studied as a relaxation of the minimum vertex cover, a type of integer programming (IP) problem. A lattice-gas model on the Erd\"os-R\'enyi random graphs of $\alpha$-uniform…

Disordered Systems and Neural Networks · Physics 2016-06-01 Satoshi Takabe , Koji Hukushima

We provide a new estimator of integral operators with smooth kernels, obtained from a set of scattered and noisy impulse responses. The proposed approach relies on the formalism of smoothing in reproducing kernel Hilbert spaces and on the…

Information Theory · Computer Science 2017-12-04 Jérémie Bigot , Paul Escande , Pierre Weiss

Understanding how the optimal value of an optimisation problem changes when its input data is modified is an old question in mathematical optimisation. This paper investigates the computation of the optimal values of a family of (possibly…

Optimization and Control · Mathematics 2026-03-02 Guillaume Derval , Damien Ernst , Quentin Louveaux , Bardhyl Miftari

Nonlinear kernels can be approximated using finite-dimensional feature maps for efficient risk minimization. Due to the inherent trade-off between the dimension of the (mapped) feature space and the approximation accuracy, the key problem…

Machine Learning · Computer Science 2018-10-10 Shahin Shahrampour , Vahid Tarokh

This paper deals with the kernel-based approximation of a multivariate periodic function by interpolation at the points of an integration lattice -- a setting that, as pointed out by Zeng, Leung, Hickernell (MCQMC2004, 2006) and Zeng,…

Numerical Analysis · Mathematics 2022-01-25 Vesa Kaarnioja , Yoshihito Kazashi , Frances Y. Kuo , Fabio Nobile , Ian H. Sloan

Recent advances in large-margin classification of data residing in general metric spaces (rather than Hilbert spaces) enable classification under various natural metrics, such as string edit and earthmover distance. A general framework…

Machine Learning · Computer Science 2014-07-14 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

A mesh-free numerical method for solving linear elliptic PDE's using the local kernel theory that was developed for manifold learning is proposed. In particular, this novel approach exploits the local kernel theory which allows one to…

Numerical Analysis · Mathematics 2019-07-02 Faheem Gilani , John Harlim

We provide an efficient unified plug-in approach for estimating symmetric properties of distributions given $n$ independent samples. Our estimator is based on profile-maximum-likelihood (PML) and is sample optimal for estimating various…

Machine Learning · Statistics 2022-10-14 Moses Charikar , Zhihao Jiang , Kirankumar Shiragur , Aaron Sidford

We propose a trust-region method that solves a sequence of linear integer programs to tackle integer optimal control problems regularized with a total variation penalty. The total variation penalty allows us to prove the existence of…

Optimization and Control · Mathematics 2022-05-09 Sven Leyffer , Paul Manns

We present an algorithm for L1-norm kernel PCA and provide a convergence analysis for it. While an optimal solution of L2-norm kernel PCA can be obtained through matrix decomposition, finding that of L1-norm kernel PCA is not trivial due to…

Machine Learning · Statistics 2020-06-12 Cheolmin Kim , Diego Klabjan

Automatic algorithms attempt to provide approximate solutions that differ from exact solutions by no more than a user-specified error tolerance. This paper describes an automatic, adaptive algorithm for approximating the solution to a…

Numerical Analysis · Mathematics 2018-09-28 Yuhan Ding , Fred J. Hickernell , Lluís Antoni Jiménez Rugama

We prove the statistical consistency of kernel Partial Least Squares Regression applied to a bounded regression learning problem on a reproducing kernel Hilbert space. Partial Least Squares stands out of well-known classical approaches as…

Methodology · Statistics 2010-08-13 Gilles Blanchard , Nicole Kraemer

Many learning algorithms are formulated in terms of finding model parameters which minimize a data-fitting loss function plus a regularizer. When the regularizer involves the l0 pseudo-norm, the resulting regularization path consists of a…

Machine Learning · Computer Science 2020-03-06 Toby Hocking , Joseph Vargovich

The combinatorial optimization problem is one of the important applications in neural network computation. The solutions of linearly constrained continuous optimization problems are difficult with an exact algorithm, but the algorithm for…

Numerical Analysis · Computer Science 2009-12-22 A. K. Ojha , C. Mallick , D. Mallick

We consider the global minimization of smooth functions based solely on function evaluations. Algorithms that achieve the optimal number of function evaluations for a given precision level typically rely on explicitly constructing an…

Optimization and Control · Mathematics 2020-12-23 Alessandro Rudi , Ulysse Marteau-Ferey , Francis Bach

Many interesting machine learning problems are best posed by considering instances that are distributions, or sample sets drawn from distributions. Previous work devoted to machine learning tasks with distributional inputs has done so…

Machine Learning · Statistics 2021-01-15 Danica J. Sutherland , Junier B. Oliva , Barnabás Póczos , Jeff Schneider

In this paper, we prove optimal convergence rates results for regularisation methods for solving linear ill-posed operator equations in Hilbert spaces. The result generalises existing convergence rates results on optimality to general…

Functional Analysis · Mathematics 2015-11-11 Vinicius Albani , Peter Elbau , Maarten V. de Hoop , Otmar Scherzer

In this contribution, kernel approximations are applied as ansatz functions within the Deep Ritz method. This allows to approximate weak solutions of elliptic partial differential equations with weak enforcement of boundary conditions using…

Numerical Analysis · Mathematics 2024-10-07 Hendrik Kleikamp , Tizian Wenzel

Given a set of 2-dimensional (2-D) scattering points, which are usually obtained from the edge detection process, the aim of ellipse fitting is to construct an elliptic equation that best fits the collected observations. However, some of…

Image and Video Processing · Electrical Eng. & Systems 2018-06-04 Hao Wang , Chi-Sing Leung , Hing Cheung So , Junli Liang , Ruibin Feng , Zifa Han

Distributed machine learning systems have been receiving increasing attentions for their efficiency to process large scale data. Many distributed frameworks have been proposed for different machine learning tasks. In this paper, we study…

Machine Learning · Computer Science 2020-07-01 Hongwei Sun , Qiang Wu