English
Related papers

Related papers: Training Lipschitz continuous operators using repr…

200 papers

This paper deals with the study of parameter dependence of extensions of Lipschitz mappings from the point of view of continuity. We show that if assuming appropriate curvature bounds for the spaces, the multivalued extension operators that…

Metric Geometry · Mathematics 2015-02-25 Rafa Espínola , Adriana Nicolae

We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics. The key contribution is a control-theoretic regularizer for dynamics fitting rooted in the notion of…

Optimization and Control · Mathematics 2019-08-01 Sumeet Singh , Spencer M. Richards , Vikas Sindhwani , Jean-Jacques E. Slotine , Marco Pavone

This paper studies the construction of a refinement kernel for a given operator-valued reproducing kernel such that the vector-valued reproducing kernel Hilbert space of the refinement kernel contains that of the given one as a subspace.…

Machine Learning · Computer Science 2011-02-08 Yuesheng Xu , Haizhang Zhang , Qinghui Zhang

This paper is devoted to the proof of Lipschitz regularity, down to the microscopic scale, for solutions of an elliptic system with highly oscillating coefficients, over a highly oscillating Lipschitz boundary. The originality of this…

Analysis of PDEs · Mathematics 2015-04-08 Carlos Kenig , Christophe Prange

We provide a new estimator of integral operators with smooth kernels, obtained from a set of scattered and noisy impulse responses. The proposed approach relies on the formalism of smoothing in reproducing kernel Hilbert spaces and on the…

Information Theory · Computer Science 2017-12-04 Jérémie Bigot , Paul Escande , Pierre Weiss

We derive minimax adaptive rates for a new, broad class of Tikhonov-regularized learning problems in Hilbert scales under general source conditions. Our analysis does not require the regression function to be contained in the hypothesis…

Statistics Theory · Mathematics 2023-09-19 Prem Talwai , David Simchi-Levi

Given a Banach lattice $L,$ the space of lattice Lipschitz operators on $L$ has been introduced as a natural Lipschitz generalization of the linear notions of diagonal operator and multiplication operator on Banach function lattices. It is…

Functional Analysis · Mathematics 2024-11-19 Roger Arnau , Jose M. Calabuig , Enrique A. Sánchez-Pérez

Attention is a powerful component of modern neural networks across a wide variety of domains. In this paper, we seek to quantify the regularity (i.e. the amount of smoothness) of the attention operation. To accomplish this goal, we propose…

Machine Learning · Statistics 2021-02-11 James Vuckovic , Aristide Baratin , Remi Tachet des Combes

We prove boundedness results for integral operators of fractional type and their higher order commutators between weighted spaces, including $L^p$-$L^q$, $L^p$-$BMO$ and $L^p$-Lipschitz estimates. The kernels of such operators satisfy…

Analysis of PDEs · Mathematics 2018-06-29 Estefanía Dalmasso , Gladis Pradolini , Wilfredo Ramos

Positive definite operator-valued kernels generalize the well-known notion of reproducing kernels, and are naturally adapted to multi-output learning situations. This paper addresses the problem of learning a finite linear combination of…

Machine Learning · Statistics 2012-06-15 Hachem Kadri , Alain Rakotomamonjy , Francis Bach , Philippe Preux

In this paper, we study the problem of early stopping for iterative learning algorithms in a reproducing kernel Hilbert space (RKHS) in the nonparametric regression framework. In particular, we work with the gradient descent and (iterative)…

Machine Learning · Statistics 2024-11-26 Yaroslav Averyanov , Alain Celisse

We characterize the reproducing kernel Hilbert spaces whose elements are $p$-integrable functions in terms of the boundedness of the integral operator whose kernel is the reproducing kernel. Moreover, for $p=2$ we show that the spectral…

Functional Analysis · Mathematics 2007-05-23 Claudio Carmeli , Ernesto De Vito , Alessandro Toigo

This paper presents new quadrature rules for functions in a reproducing kernel Hilbert space using nodes drawn by a sampling algorithm known as randomly pivoted Cholesky. The resulting computational procedure compares favorably to previous…

Numerical Analysis · Mathematics 2023-12-08 Ethan N. Epperly , Elvira Moreno

We propose Kernel Predictive Control (KPC), a learning-based predictive control strategy that enjoys deterministic guarantees of safety. Noise-corrupted samples of the unknown system dynamics are used to learn several models through the…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Emilio T. Maddalena , Paul Scharnhorst , Yuning Jiang , Colin N. Jones

Deriving sharp and computable upper bounds of the Lipschitz constant of deep neural networks is crucial to formally guarantee the robustness of neural-network based models. We analyse three existing upper bounds written for the $l^2$ norm.…

Machine Learning · Computer Science 2024-10-29 Moreno Pintore , Bruno Després

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

It has been shown that a neural network's Lipschitz constant can be leveraged to derive robustness guarantees, to improve generalizability via regularization or even to construct invertible networks. Therefore, a number of methods varying…

Machine Learning · Computer Science 2026-02-18 Tom A. Splittgerber

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

We initiate the study of nonsmooth optimization problems under bounded local subgradient variation, which postulates bounded difference between (sub)gradients in small local regions around points, in either average or maximum sense. The…

Optimization and Control · Mathematics 2024-11-05 Jelena Diakonikolas , Cristóbal Guzmán

The linear quadratic regulator problem is central in optimal control and was investigated since the very beginning of control theory. Nevertheless, when it includes affine state constraints, it remains very challenging from the classical…

Optimization and Control · Mathematics 2021-03-30 Pierre-Cyril Aubin-Frankowski
‹ Prev 1 8 9 10 Next ›