English
Related papers

Related papers: On the Continuity of Characteristic Functionals an…

200 papers

Standard sparse pseudo-input approximations to the Gaussian process (GP) cannot handle complex functions well. Sparse spectrum alternatives attempt to answer this but are known to over-fit. We suggest the use of variational inference for…

Machine Learning · Statistics 2015-03-23 Yarin Gal , Richard Turner

In high-dimensional linear models, the sparsity assumption is typically made, stating that most of the parameters are equal to zero. Under the sparsity assumption, estimation and, recently, inference have been well studied. However, in…

Methodology · Statistics 2019-07-09 Yinchu Zhu , Jelena Bradic

We derive fundamental sampling bounds for smooth signals in continuous settings without sparsity assumptions. By introducing the Fourier ratio as a measure of spectral compressibility induced by smoothness, we obtain explicit, deterministic…

Classical Analysis and ODEs · Mathematics 2026-01-27 A. Iosevich , E. Palsson , A. Yavicoli

We investigate the use of models from the theory of regularity structures as features in machine learning tasks. A model is a polynomial function of a space-time signal designed to well-approximate solutions to partial differential…

Machine Learning · Statistics 2023-12-05 Ilya Chevyrev , Andris Gerasimovics , Hendrik Weber

Sparse feature selection is necessary when we fit statistical models, we have access to a large group of features, don't know which are relevant, but assume that most are not. Alternatively, when the number of features is larger than the…

Applications · Statistics 2017-04-04 Emiliano Diaz

In many applications, smooth processes generate data that is recorded under a variety of observation regimes, such as dense, sparse or fragmented observations that are often contaminated with error. The statistical goal of registering and…

Applications · Statistics 2019-12-12 James Matuk , Karthik Bharath , Oksana Chkrebtii , Sebastian Kurtek

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Computer Science 2015-08-25 Rémi Gribonval , Rodolphe Jenatton , Francis Bach

The sparse polynomial approximation of continuous functions has emerged as a prominent area of interest in function approximation theory in recent years. A key challenge within this domain is the accurate estimation of approximation errors.…

Numerical Analysis · Mathematics 2025-06-10 Renzhong Feng , Bowen Zhang

We derive necessary and sufficient conditions for a continuous bounded function $f: R\to C$ to be a characteristic function of a probability measure. The Cauchy transform $K_f$ of $f$ is used as analytic continuation of $f$ to the upper and…

Classical Analysis and ODEs · Mathematics 2020-09-11 Saulius Norvidas

A simple model of an irreversible process is introduced. The equation of iterations in the model includes a noise generation term. We study the properties of the system when the noise generation term is a stochastic process (e.g. a random…

Chaotic Dynamics · Physics 2007-05-23 M. A. Sozanski , J. J. Zebrowski

The interest in "Physically Unclonable Function"-devices has increased rapidly over the last few years, as they have several interesting properties for system security related applications like, for example, the management of cryptographic…

Applications · Statistics 2014-09-30 Benjamin Hackl , Daniel Kurz , Clemens Heuberger , Jürgen Pilz , Martin Deutschmann

Stochastic processes with multiplicative noise have been studied independently in several different contexts over the past decades. We focus on the regime, found for a generic set of control parameters, in which stochastic processes with…

Statistical Mechanics · Physics 2015-06-25 D. Sornette

The spectrum and coherency are useful quantities for characterizing the temporal correlations and functional relations within and between point processes. This paper begins with a review of these quantities, their interpretation and how…

Biological Physics · Physics 2007-05-23 M. R. Jarvis , P. P. Mitra

We develop new discrete uncertainty principles in terms of numerical sparsity, which is a continuous proxy for the 0-norm. Unlike traditional sparsity, the continuity of numerical sparsity naturally accommodates functions which are nearly…

Information Theory · Computer Science 2017-05-26 Afonso S. Bandeira , Megan E. Lewis , Dustin G. Mixon

The signature of a path, as a fundamental object in Rough path theory, serves as a generating function for non-commutative monomials on path space. It transforms the path into a grouplike element in the tensor algebra space, summarising the…

Probability · Mathematics 2024-03-04 Terry Lyons , Hao Ni , Jiajie Tao

In this paper, we aim at characterizing generalized functionals of discrete-time normal martingales. Let $M=(M_n)_{n\in \mathbb{N}}$ be a discrete-time normal martingale that has the chaotic representation property. We first construct…

Probability · Mathematics 2015-04-21 Caishi Wang , Jinshu Chen

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

A central question in rough path theory is characterising the law of stochastic processes on path spaces. It is established in [I. Chevyrev & T. Lyons, Characteristic functions of measures on geometric rough paths, Ann. Probab. 44 (2016),…

Probability · Mathematics 2025-08-26 Siran Li , Zijiu Lyu , Hao Ni , Jiajie Tao

We consider the problem of clustering functional data while jointly selecting the most relevant features for classification. This problem has never been tackled before in the functional data context, and it requires a proper definition of…

Methodology · Statistics 2015-01-21 Davide Floriello , Valeria Vitelli

The purpose of the present paper is to give unified expressions to the characteristic functions of all elliptical and related distributions. Those distributions including the multivariate elliptical symmetric distributions and some…

Statistics Theory · Mathematics 2023-11-14 Chuancun Yin , Hua Dong