English
Related papers

Related papers: An RKHS-Based Semiparametric Approach to Nonlinear…

200 papers

We study distributed learning with the least squares regularization scheme in a reproducing kernel Hilbert space (RKHS). By a divide-and-conquer approach, the algorithm partitions a data set into disjoint data subsets, applies the least…

Machine Learning · Computer Science 2017-03-14 Shao-Bo Lin , Xin Guo , Ding-Xuan Zhou

This paper explores methods for estimating or approximating the total variation distance and the chi-squared divergence of probability measures within topological sample spaces, using independent and identically distributed samples. Our…

Information Theory · Computer Science 2023-12-20 Chong Xiao Wang , Wee Peng Tay

We give a dimensionality reduction procedure to approximate the sum of distances of a given set of $n$ points in $R^d$ to any "shape" that lies in a $k$-dimensional subspace. Here, by "shape" we mean any set of points in $R^d$. Our…

Data Structures and Algorithms · Computer Science 2021-06-25 Zhili Feng , Praneeth Kacham , David P. Woodruff

We analyse the convergence of sampling algorithms for functions in reproducing kernel Hilbert spaces (RKHS). To this end, we discuss approximation properties of kernel regression under minimalistic assumptions on both the kernel and the…

Machine Learning · Statistics 2025-04-21 Armin Iske

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

In this paper, we introduce principal asymmetric least squares (PALS) as a unified framework for linear and nonlinear sufficient dimension reduction. Classical methods such as sliced inverse regression (Li, 1991) and principal support…

Statistics Theory · Mathematics 2020-02-14 Abdul-Nasah Soale , Yuexiao Dong

We study recursive regularized learning algorithms in the reproducing kernel Hilbert space (RKHS) with non-stationary online data streams. We introduce the concept of random Tikhonov regularization path and decompose the tracking error of…

Machine Learning · Computer Science 2025-10-24 Xiwei Zhang , Yan Chen , Tao Li

This paper investigates solution strategies for nonlinear problems in Hilbert spaces, such as nonlinear partial differential equations (PDEs) in Sobolev spaces, when only finite measurements are available. We formulate this as a nonlinear…

Numerical Analysis · Mathematics 2025-06-06 Daozhe Lin , Qiang Du

In this work, we develop and study an empirical projection operator scheme for solving nonparametric regression problems. This scheme is based on an approximate projection of the regression function over a suitable reproducing kernel…

Statistics Theory · Mathematics 2020-02-04 Bilel Bousselmi , Jean-François Dupuy , Abderrazek Karoui

As a representation learning method, nearest regularized subspace(NRS) algorithm is an effective tool to obtain both accuracy and speed for PolSAR image classification. However, existing NRS methods use the polarimetric feature vector but…

Image and Video Processing · Electrical Eng. & Systems 2023-02-08 Junfei Shi , Haiyan Jin

We present a new framework for online Least Squares algorithms for nonlinear modeling in RKH spaces (RKHS). Instead of implicitly mapping the data to a RKHS (e.g., kernel trick), we map the data to a finite dimensional Euclidean space,…

Machine Learning · Computer Science 2016-06-14 Pantelis Bouboulis , Spyridon Pougkakiotis , Sergios Theodoridis

In this paper, we propose a reproducing kernel Hilbert space method (RKHSM) for solving the sine--Gordon (SG) equation with initial and boundary conditions based on the reproducing kernel theory. Its exact solution is represented in the…

Numerical Analysis · Mathematics 2013-04-03 Ali Akgül , Mustafa Inc

In modern robotics, effectively computing optimal control policies under dynamically varying environments poses substantial challenges to the off-the-shelf parametric policy gradient methods, such as the Deep Deterministic Policy Gradient…

Robotics · Computer Science 2022-03-29 Apan Dastider , Mingjie Lin

In this paper, we consider the resonance problem for the cubic nonlinear Helmholtz equation in the subwavelength regime. We derive a discrete model for approximating the subwavelength resonances of finite systems of high-contrast resonators…

Mathematical Physics · Physics 2025-04-17 Habib Ammari , Thea Kosche

This article focuses on solving parametric transmission problems in one and two spatial dimensions. These problems belong to a class of partial differential equations that arise in the modeling of physical systems with heterogeneous…

Numerical Analysis · Mathematics 2026-03-11 Shima Baharlouei , Jamie Taylor , David Pardo

Regularization is a long-standing challenge for ill-posed linear inverse problems, and a prototype is the Fredholm integral equation of the first kind with additive Gaussian measurement noise. We introduce a new RKHS regularization adaptive…

Numerical Analysis · Mathematics 2023-12-06 Fei Lu , Miao-Jung Yvonne Ou

Due to diverse architectures in deep neural networks (DNNs) with severe overparameterization, regularization techniques are critical for finding optimal solutions in the huge hypothesis space. In this paper, we propose an effective…

Machine Learning · Computer Science 2022-02-25 Yang Zhao , Hao Zhang

As its name suggests, sufficient dimension reduction (SDR) targets to estimate a subspace from data that contains all information sufficient to explain a dependent variable. Ample approaches exist to SDR, some of the most recent of which…

Methodology · Statistics 2020-12-15 Emmanuel Jordy Menvouta , Sven Serneels , Tim Verdonck

Realistic image super-resolution (SR) focuses on transforming real-world low-resolution (LR) images into high-resolution (HR) ones, handling more complex degradation patterns than synthetic SR tasks. This is critical for applications like…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Chaowei Fang , Bolin Fu , De Cheng , Lechao Cheng , Guanbin Li

This paper proposes a supervised dimension reduction methodology for tensor data which has two advantages over most image-based prognostic models. First, the model does not require tensor data to be complete which expands its application to…

Machine Learning · Computer Science 2023-06-06 Chengyu Zhou , Xiaolei Fang