English
Related papers

Related papers: Random sampling stability in weighted reproducing …

200 papers

Interest in generative models has grown tremendously in the past decade. However, their training performance can be adversely affected by contamination, where outliers are encoded in the representation of the model. This results in the…

Machine Learning · Statistics 2020-06-24 Arun Pandey , Joachim Schreurs , Johan A. K. Suykens

Many supervised learning problems involve high-dimensional data such as images, text, or graphs. In order to make efficient use of data, it is often useful to leverage certain geometric priors in the problem at hand, such as invariance to…

Machine Learning · Statistics 2021-11-08 Alberto Bietti , Luca Venturi , Joan Bruna

Our interest lies in the recoverability properties of compressed tensors under the \textit{canonical polyadic decomposition} (CPD) model. The considered problem is well-motivated in many applications, e.g., hyperspectral image and video…

Signal Processing · Electrical Eng. & Systems 2020-08-26 Shahana Ibrahim , Xiao Fu , Xingguo Li

A typical approach in estimating the learning rate of a regularized learning scheme is to bound the approximation error by the sum of the sampling error, the hypothesis error and the regularization error. Using a reproducing kernel space…

Machine Learning · Statistics 2011-01-28 Guohui Song , Haizhang Zhang

We study the following basic machine learning task: Given a fixed set of $d$-dimensional input points for a linear regression problem, we wish to predict a hidden response value for each of the points. We can only afford to attain the…

Machine Learning · Computer Science 2018-06-07 Michał Dereziński , Manfred K. Warmuth

In this paper we combine the theory of reproducing kernel Hilbert spaces with the field of collocation methods to solve boundary value problems with special emphasis on reproducing property of kernels. From the reproducing property of…

Numerical Analysis · Mathematics 2019-03-26 Babak Azarnavid , Mahdi Emamjome , Mohammad Nabati , Saeid Abbasbandy

This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate shifts. By a…

Machine Learning · Statistics 2024-06-06 Yihang Chen , Fanghui Liu , Taiji Suzuki , Volkan Cevher

In the context of kernel density estimation, we give a characterization of the kernels for which the parametric mean integrated squared error rate $n^{-1}$ may be obtained, where $n$ is the sample size. Also, for the cases where this rate…

Statistics Theory · Mathematics 2011-11-22 J. E. Chacón , J. Montanero , A. G. Nogales

This paper considers the use of total variation regularization in the recovery of approximately gradient sparse signals from their noisy discrete Fourier samples in the context of compressed sensing. It has been observed over the last…

Numerical Analysis · Mathematics 2014-07-22 Clarice Poon

Finding a suitable measurement matrix is an important topic in compressed sensing. Though the known random matrix, whose entries are drawn independently from a certain probability distribution, can be used as a measurement matrix and…

Information Theory · Computer Science 2013-07-09 Yi-Zheng Fan , Tao Huang , Ming Zhu

We present a novel distributionally robust framework for dynamic programming that uses kernel methods to design feedback control policies. Specifically, we leverage kernel mean embedding to map the transition probabilities governing the…

Systems and Control · Electrical Eng. & Systems 2023-12-20 Licio Romao , Ashish R. Hota , Alessandro Abate

Reproducing Kernel Hilbert Space (RKHS) embedding of probability distributions has proved to be an effective approach, via MMD (maximum mean discrepancy), for nonparametric hypothesis testing problems involving distributions defined over…

Statistics Theory · Mathematics 2025-10-17 Soumya Mukherjee , Bharath K. Sriperumbudur

The nonparametric problem of detecting existence of an anomalous interval over a one dimensional line network is studied. Nodes corresponding to an anomalous interval (if exists) receive samples generated by a distribution q, which is…

Information Theory · Computer Science 2016-04-11 Shaofeng Zou , Yingbin Liang , H. Vincent Poor

We study constrained selection sets of random closed sets defined on a non-atomic probability space. Given a random interval $Y=[y_L,y_U]$ and scalar constraints on the expectation or the median of admissible selections, we characterize the…

Probability · Mathematics 2026-03-20 Arie Beresteanu , Behrooz Moosavi Rameznzadeh

This paper introduces a kernel discrepancy-based framework for rerandomization to enhance the precision of causal inference in controlled experiments. We demonstrate that the kernel discrepancy is the key part of the variance upper bound…

Methodology · Statistics 2025-11-05 Yiou Li , Lulu Kang

We consider the problem of change point detection for high-dimensional distributions in a location family when the dimension can be much larger than the sample size. In change point analysis, the widely used cumulative sum (CUSUM)…

Statistics Theory · Mathematics 2021-10-14 Mengjia Yu , Xiaohui Chen

This paper considers different facets of the interplay between reproducing kernel Hilbert spaces (RKHS) and stable analysis/synthesis processes: First, we analyze the structure of the reproducing kernel of a RKHS using frames and…

Functional Analysis · Mathematics 2019-04-02 Michael Speckbacher , Peter Balazs

The standard Sobolev space $W^s_2(\mathbb{R}^d)$, with arbitrary positive integers $s$ and $d$ for which $s>d/2$, has the reproducing kernel $$ K_{d,s}(x,t)=\int_{\mathbb{R}^d}\frac{\prod_{j=1}^d\cos\left(2\pi\,(x_j-t_j)u_j\right)}…

Numerical Analysis · Mathematics 2018-07-17 Erich Novak , Mario Ullrich , Henryk Woźniakowski , Shun Zhang

We study generalized bootstrap confidence regions for the mean of a random vector whose coordinates have an unknown dependency structure. The random vector is supposed to be either Gaussian or to have a symmetric and bounded distribution.…

Statistics Theory · Mathematics 2010-07-02 Sylvain Arlot , Gilles Blanchard , Etienne Roquain

Nonparametric detection of existence of an anomalous structure over a network is investigated. Nodes corresponding to the anomalous structure (if one exists) receive samples generated by a distribution q, which is different from a…

Machine Learning · Statistics 2017-10-11 Shaofeng Zou , Yingbin Liang , H. Vincent Poor