English
Related papers

Related papers: Kernel-Based Just-In-Time Learning for Passing Exp…

200 papers

This paper considers the design of nonlinear data-enabled predictive control (DeePC) using kernel functions. Compared with existing methods that use kernels to parameterize multi-step predictors for nonlinear DeePC, we adopt a novel,…

Optimization and Control · Mathematics 2025-01-30 Thomas de Jong , Siep Weiland , Mircea Lazar

Representation learning is an important step in the machine learning pipeline. Given the current biological sequencing data volume, learning an explicit representation is prohibitive due to the dimensionality of the resulting feature…

Machine Learning · Computer Science 2023-04-04 Sarwan Ali , Usama Sardar , Murray Patterson , Imdad Ullah Khan

We address the problem of causal effect estimation in the presence of unobserved confounding, but where proxies for the latent confounder(s) are observed. We propose two kernel-based methods for nonlinear causal effect estimation in this…

Inference in popular nonparametric Bayesian models typically relies on sampling or other approximations. This paper presents a general methodology for constructing novel tractable nonparametric Bayesian methods by applying the kernel trick…

Machine Learning · Statistics 2011-08-15 Ferenc Huszár , Simon Lacoste-Julien

This paper focuses on generalization performance analysis for distributed algorithms in the framework of learning theory. Taking distributed kernel ridge regression (DKRR) for example, we succeed in deriving its optimal learning rates in…

Machine Learning · Computer Science 2020-03-30 Shao-Bo Lin , Di Wang , Ding-Xuan Zhou

Envelope methods improve the estimation efficiency in multivariate linear regression by identifying and separating the material and immaterial parts of the responses or the predictors and estimating the regression coefficients using only…

Methodology · Statistics 2025-09-10 Tate Jacobson

We propose a kernel-based partial permutation test for checking the equality of functional relationship between response and covariates among different groups. The main idea, which is intuitive and easy to implement, is to keep the…

Methodology · Statistics 2021-11-01 Xinran Li , Bo Jiang , Jun S. Liu

Linear autoregressive models serve as basic representations of discrete time stochastic processes. Different attempts have been made to provide non-linear versions of the basic autoregressive process, including different versions based on…

Machine Learning · Statistics 2016-03-17 Edgar A. Valencia , Mauricio A. Álvarez

Conditional expectiles are becoming an increasingly important tool in finance as well as in other areas of applications. We analyse a support vector machine type approach for estimating conditional expectiles and establish learning rates…

Machine Learning · Statistics 2017-02-28 Muhammad Farooq , Ingo Steinwart

Iterative message passing detection based on expectation propagation(EP) has demonstrated near-optimum performance in many signal processing and communication scenarios. The method remains feasible even for channel impulse responses (CIRs),…

Information Theory · Computer Science 2025-09-23 Jannis Clausius , Luca Schmid , Laurent Schmalen , Stephan ten Brink

In kernel methods, temporal information on the data is commonly included by using time-delayed embeddings as inputs. Recently, an alternative formulation was proposed by defining a gamma-filter explicitly in a reproducing kernel Hilbert…

Machine Learning · Statistics 2017-06-13 Steven Van Vaerenbergh , Simone Scardapane , Ignacio Santamaria

This paper derives error bounds for regression in continuous time over subsets of certain types of Riemannian manifolds.The regression problem is typically driven by a nonlinear evolution law taking values on the manifold, and it is cast as…

Dynamical Systems · Mathematics 2022-09-09 Nathan Powell , Jia Guo , Sai Tej Parachuri , John Burns , Boone Estes , Andrew Kurdila

In this paper we introduce a kernel-based measure for detecting differences between two conditional distributions. Using the `kernel trick' and nearest-neighbor graphs, we propose a consistent estimate of this measure which can be computed…

Methodology · Statistics 2024-08-30 Anirban Chatterjee , Ziang Niu , Bhaswar B. Bhattacharya

Nonlocal operators with integral kernels have become a popular tool for designing solution maps between function spaces, due to their efficiency in representing long-range dependence and the attractive feature of being resolution-invariant.…

Machine Learning · Statistics 2022-05-24 Fei Lu , Qingci An , Yue Yu

We propose an adaptive scheme for distributed learning of nonlinear functions by a network of nodes. The proposed algorithm consists of a local adaptation stage utilizing multiple kernels with projections onto hyperslabs and a diffusion…

Signal Processing · Electrical Eng. & Systems 2018-09-05 Ban-Sok Shin , Masahiro Yukawa , Renato Luis Garrido Cavalcante , Armin Dekorsy

Extended Dynamic Mode Decomposition (EDMD) is a popular data-driven method to approximate the Koopman operator for deterministic and stochastic (control) systems. This operator is linear and encompasses full information on the (expected…

Dynamical Systems · Mathematics 2023-12-19 Friedrich Philipp , Manuel Schaller , Karl Worthmann , Sebastian Peitz , Feliks Nüske

We introduce a similarity function on formulae of signal temporal logic (STL). It comes in the form of a kernel function, well known in machine learning as a conceptually and computationally efficient tool. The corresponding kernel trick…

Logic in Computer Science · Computer Science 2022-01-26 Luca Bortolussi , Giuseppe Maria Gallo , Jan Křetínský , Laura Nenzi

In this abstract paper, we introduce a new kernel learning method by a nonparametric density estimator. The estimator consists of a group of k-centroids clusterings. Each clustering randomly selects data points with randomly selected…

Machine Learning · Computer Science 2017-08-02 Xiao-Lei Zhang

Adaptive experiments improve efficiency by adjusting treatment assignments based on past outcomes, but this adaptivity breaks the i.i.d.\ assumptions that underpin classical asymptotics. At the same time, many questions of interest are…

Machine Learning · Statistics 2026-05-05 Houssam Zenati , Bariscan Bozkurt , Arthur Gretton

Boosting combines weak (biased) learners to obtain effective learning algorithms for classification and prediction. In this paper, we show a connection between boosting and kernel-based methods, highlighting both theoretical and practical…

Machine Learning · Statistics 2017-04-14 Aleksandr Y. Aravkin , Giulio Bottegal , Gianluigi Pillonetto