English
Related papers

Related papers: Kernel-Based Regularized Continuous-Time System Id…

200 papers

We develop an anomaly-detection method when systematic anomalies, possibly statistically very similar to genuine inputs, are affecting control systems at the input and/or output stages. The method allows anomaly-free inputs (i.e., those…

Methodology · Statistics 2022-02-01 Ning Sun , Chen Yang , Ričardas Zitikis

Conformal prediction (CP) is a distribution-free framework for achieving probabilistic guarantees on black-box models. CP is generally applied to a model post-training. Recent research efforts, on the other hand, have focused on optimizing…

Machine Learning · Computer Science 2025-02-11 Sima Noorani , Orlando Romero , Nicolo Dal Fabbro , Hamed Hassani , George J. Pappas

This paper carries out a large dimensional analysis of a variation of kernel ridge regression that we call \emph{centered kernel ridge regression} (CKRR), also known in the literature as kernel ridge regression with offset. This modified…

Machine Learning · Statistics 2020-04-22 Khalil Elkhalil , Abla Kammoun , Xiangliang Zhang , Mohamed-Slim Alouini , Tareq Al-Naffouri

Parametric prediction error methods constitute a classical approach to the identification of linear dynamic systems with excellent large-sample properties. A more recent regularized approach, inspired by machine learning and Bayesian…

Systems and Control · Computer Science 2017-10-12 Johan Wågberg , Dave Zachariah , Thomas B. Schön

Spectral risk measures (SRMs) belong to the family of coherent risk measures. A natural estimator for the class of SRMs has the form of L-statistics. Various authors have studied and derived the asymptotic properties of the empirical…

Statistical Finance · Quantitative Finance 2023-12-11 Suparna Biswas , Rituparna Sen

Quantum detector tomography (QDT) is a fundamental technique for calibrating quantum devices and performing quantum engineering tasks. In this paper, we utilize regularization to improve the QDT accuracy whenever the probe states are…

The ability to generalize under distributional shifts is essential to reliable machine learning, while models optimized with empirical risk minimization usually fail on non-$i.i.d$ testing data. Recently, invariant learning methods for…

Machine Learning · Computer Science 2021-10-26 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

Structural equation models (SEMs) have been widely adopted for inference of causal interactions in complex networks. Recent examples include unveiling topologies of hidden causal networks over which processes such as spreading diseases, or…

Machine Learning · Statistics 2017-04-05 Yanning Shen , Brian Baingana , Georgios B. Giannakis

In this paper, we propose an outlier-robust regularized kernel-based method for linear system identification. The unknown impulse response is modeled as a zero-mean Gaussian process whose covariance (kernel) is given by the recently…

Machine Learning · Statistics 2013-12-25 Giulio Bottegal , Aleksandr Y. Aravkin , Hakan Hjalmarsson , Gianluigi Pillonetto

The paper investigates the problems of quickest change detection in Markov models and hidden Markov models (HMMs). Sequential observations are taken from a (hidden) Markov model. At some unknown time, an event occurs in the system and…

Signal Processing · Electrical Eng. & Systems 2023-11-09 Qi Zhang , Zhongchang Sun , Luis C. Herrera , Shaofeng Zou

In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability.…

Machine Learning · Computer Science 2015-08-31 Songlin Zhao

In this paper, we propose a novel algorithm for the identification of Hammerstein systems. Adopting a Bayesian approach, we model the impulse response of the unknown linear dynamic system as a realization of a zero-mean Gaussian process.…

Systems and Control · Computer Science 2016-05-20 Riccardo Sven Risuleo , Giulio Bottegal , Håkan Hjalmarsson

The classical approach to linear system identification is given by parametric Prediction Error Methods (PEM). In this context, model complexity is often unknown so that a model order selection step is needed to suitably trade-off bias and…

Machine Learning · Statistics 2013-03-13 Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto

Random feature (RF) has been widely used for node consistency in decentralized kernel ridge regression (KRR). Currently, the consistency is guaranteed by imposing constraints on coefficients of features, necessitating that the random…

Machine Learning · Computer Science 2024-09-23 Ruikai Yang , Fan He , Mingzhen He , Jie Yang , Xiaolin Huang

The best possible precision is one of the key figures in metrology, but this is established by the exact response of the detection apparatus, which is often unknown. There exist techniques for detector characterisation, that have been…

Quantum Physics · Physics 2016-03-23 Matteo Altorio , Marco G. Genoni , Fabrizia Somma , Marco Barbieri

A kernelization is an efficient algorithm that given an instance of a parameterized problem returns an equivalent instance of size bounded by some function of the input parameter value. It is quite well understood which problems do or…

Data Structures and Algorithms · Computer Science 2025-10-02 Leonid Antipov , Stefan Kratsch

This paper studies the consistency of the kernel-based neural ranking model K-NRM, a recent state-of-the-art neural IR model, which is important for reproducible research and deployment in the industry. We find that K-NRM has low variance…

Information Retrieval · Computer Science 2018-09-28 Mary Arpita Pyreddy , Varshini Ramaseshan , Narendra Nath Joshi , Zhuyun Dai , Chenyan Xiong , Jamie Callan , Zhiyuan Liu

We introduce a closed-form method for identification of discrete-time linear time-variant systems from data, formulating the learning problem as a regularized least squares problem where the regularizer favors smooth solutions within a…

Optimization and Control · Mathematics 2022-05-31 Maria Carvalho , Claudia Soares , Pedro Lourenço , Rodrigo Ventura

Kernel ridge regression (KRR), also known as the least-squares support vector machine, is a fundamental method for learning functions from finite samples. While most existing analyses focus on the noisy setting with constant-level label…

Machine Learning · Statistics 2025-04-14 Jihao Long , Xiaojun Peng , Lei Wu

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira