English
Related papers

Related papers: Generation of point sets by convex optimization fo…

200 papers

Under investigation is the problem of finding the best approximation of a function in a Hilbert space subject to convex constraints and prescribed nonlinear transformations. We show that in many instances these prescriptions can be…

Functional Analysis · Mathematics 2021-06-17 Patrick L. Combettes , Zev C. Woodstock

Generalizing both mixed-integer linear optimization and convex optimization, mixed-integer convex optimization possesses broad modeling power but has seen relatively few advances in general-purpose solvers in recent years. In this paper, we…

Optimization and Control · Mathematics 2017-09-18 Miles Lubin , Emre Yamangil , Russell Bent , Juan Pablo Vielma

Reinforcement learning consists of finding policies that maximize an expected cumulative long-term reward in a Markov decision process with unknown transition probabilities and instantaneous rewards. In this paper, we consider the problem…

Systems and Control · Computer Science 2018-07-31 Santiago Paternain , Juan Andrés Bazerque , Austin Small , Alejandro Ribeiro

We demonstrate an equivalence between reproducing kernel Hilbert space (RKHS) embeddings of conditional distributions and vector-valued regressors. This connection introduces a natural regularized loss function which the RKHS embeddings…

Machine Learning · Computer Science 2012-07-25 Steffen Grünewälder , Guy Lever , Luca Baldassarre , Sam Patterson , Arthur Gretton , Massimilano Pontil

Convex optimization is a well-established research area with applications in almost all fields. Over the decades, multiple approaches have been proposed to solve convex programs. The development of interior-point methods allowed solving a…

Optimization and Control · Mathematics 2020-01-08 Ahmed Douik , Babak Hassibi

Kernel-based methods provide flexible and accurate algorithms for the reconstruction of functions from meshless samples. A major question in the use of such methods is the influence of the samples locations on the behavior of the…

Numerical Analysis · Mathematics 2018-10-09 Gabriele Santin , Bernard Haasdonk

Inverse Optimization (IO) is a framework for learning the unknown objective function of an expert decision-maker from a past dataset. In this paper, we extend the hypothesis class of IO objective functions to a reproducing kernel Hilbert…

Machine Learning · Computer Science 2024-11-01 Youyuan Long , Tolga Ok , Pedro Zattoni Scroccaro , Peyman Mohajerin Esfahani

In this paper, we study two general classes of optimization algorithms for kernel methods with convex loss function and quadratic norm regularization, and analyze their convergence. The first approach, based on fixed-point iterations, is…

Machine Learning · Computer Science 2013-07-02 Francesco Dinuzzo

This paper is devoted to general nonconvex problems of multiobjective optimization in Hilbert spaces. Based on Mordukhovich's limiting subgradients, we define a new notion of Pareto critical points for such problems, establish necessary…

Optimization and Control · Mathematics 2024-03-18 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , B. S. Mordukhovich , P. R. Silva Filho

We introduce a functional gradient descent trajectory optimization algorithm for robot motion planning in Reproducing Kernel Hilbert Spaces (RKHSs). Functional gradient algorithms are a popular choice for motion planning in complex…

Robotics · Computer Science 2016-01-15 Zita Marinho , Anca Dragan , Arun Byravan , Byron Boots , Siddhartha Srinivasa , Geoffrey Gordon

We consider the problem of optimising functions in the reproducing kernel Hilbert space (RKHS) of a Mat\'ern kernel with smoothness parameter $\nu$ over the domain $[0,1]^d$ under noisy bandit feedback. Our contribution, the $\pi$-GP-UCB…

Machine Learning · Computer Science 2023-02-28 David Janz , David R. Burt , Javier González

Data-dependent greedy algorithms in kernel spaces are known to provide fast converging interpolants, while being extremely easy to implement and efficient to run. Despite this experimental evidence, no detailed theory has yet been…

Numerical Analysis · Mathematics 2022-10-31 Tizian Wenzel , Gabriele Santin , Bernard Haasdonk

We propose the algorithm that solves the symmetric cone programs (SCPs) by iteratively calling the projection and rescaling methods the algorithms for solving exceptional cases of SCP. Although our algorithm can solve SCPs by itself, we…

Optimization and Control · Mathematics 2024-01-22 Shin-ichi Kanoh , Akiko Yoshise

We develop a mathematical framework to address a broad class of metric and preference learning problems within a Hilbert space. We obtain a novel representer theorem for the simultaneous task of metric and preference learning. Our key…

Machine Learning · Computer Science 2025-10-28 Peyman Morteza

Motivated by applications, we consider here new operator theoretic approaches to Conditional mean embeddings (CME). Our present results combine a spectral analysis-based optimization scheme with the use of kernels, stochastic processes, and…

Machine Learning · Computer Science 2023-05-16 Palle E. T. Jorgensen , Myung-Sin Song , James Tian

The numerical performance of algorithms can be studied using test sets or procedures that generate such problems. This paper proposes various methods for generating linear, semidefinite, and second-order cone optimization problems.…

Optimization and Control · Mathematics 2023-02-03 Mohammadhossein Mohammadisiahroudi , Ramin Fakhimi , Brandon Augustino , Tamás Terlaky

$\renewcommand{\Re}{\mathbb{R}}$ We develop a general randomized technique for solving "implic it" linear programming problems, where the collection of constraints are defined implicitly by an underlying ground set of elements. In many…

Computational Geometry · Computer Science 2021-12-24 Timothy M. Chan , Sariel Har-Peled , Mitchell Jones

Theoretical studies have proven that the Hilbert space has remarkable performance in many fields of applications. Frames in tensor product of Hilbert spaces were introduced to generalize the inner product to high-order tensors. However,…

Machine Learning · Statistics 2017-11-15 Yunfei Ye

Kernel-based methods in Numerical Analysis have the advantage of yielding optimal recovery processes in the "native" Hilbert space $\calh$ in which they are reproducing. Continuous kernels on compact domains have an expansion into…

Numerical Analysis · Mathematics 2018-10-09 Gabriele Santin , Robert Schaback

We recently introduced a scale of kernel-based greedy schemes for approximating the solutions of elliptic boundary value problems. The procedure is based on a generalized interpolation framework in reproducing kernel Hilbert spaces and was…

Numerical Analysis · Mathematics 2025-07-10 Bernard Haasdonk , Gabriele Santin , Tizian Wenzel