English
Related papers

Related papers: Model inference for Ordinary Differential Equation…

200 papers

No matter the nature of the response and/or explanatory variables in a regression model, some basic issues such as the existence of an effect of the predictor on the response, or the assessment of a common shape across groups of…

Applications · Statistics 2020-09-01 María Alonso-Pena , Jose Ameijeiras-Alonso , Rosa M. Crujeiras

Learning with kernels is an important concept in machine learning. Standard approaches for kernel methods often use predefined kernels that require careful selection of hyperparameters. To mitigate this burden, we propose in this paper a…

Machine Learning · Computer Science 2020-06-26 Yufan Zhou , Changyou Chen , Jinhui Xu

Nonlinear dynamical systems with regime transitions are typically described by ordinary differential equations with jumping parameters parameters. Traditional methods often treat change-point detection and parameter estimation as separate…

Machine Learning · Statistics 2026-04-29 Yuhe Bai , Chengli Tan , Jiaqi Li , Xiangjun Wang , Zhikun Zhang

We obtain upper bounds for the estimation error of Kernel Ridge Regression (KRR) for all non-negative regularization parameters, offering a geometric perspective on various phenomena in KRR. As applications: 1. We address the multiple…

Statistics Theory · Mathematics 2024-10-10 Georgios Gavrilopoulos , Guillaume Lecué , Zong Shang

Inferring control parameters in non-linear dynamical systems is an important task in analysing general dynamical behaviours, particularly in the presence of inherently deterministic chaos. Traditional approaches often rely on…

Chaotic Dynamics · Physics 2025-06-19 L. Lober , M. S. Palmero , F. A. Rodrigues

Detection and identification of nonlinearity is a task of high importance for structural dynamics. Detecting nonlinearity in a structure, which has been designed to operate in its linear region, might indicate the existence of damage.…

Machine Learning · Computer Science 2024-01-08 G. Tsialiamanis , C. R. Farrar

Previous results pertaining to algebraic state and parameter estimation of linear systems based on a special construction of a forward-backward kernel representation of linear differential invariants are extended to handle large noise in…

Systems and Control · Electrical Eng. & Systems 2021-02-02 Debarshi Patanjali Ghoshal , Hannah Michalska

Deep kernel learning combines the non-parametric flexibility of kernel methods with the inductive biases of deep learning architectures. We propose a novel deep kernel learning model and stochastic variational inference procedure which…

Machine Learning · Statistics 2016-11-03 Andrew Gordon Wilson , Zhiting Hu , Ruslan Salakhutdinov , Eric P. Xing

We study the problem of estimating the parameters of a regression model from a set of observations, each consisting of a response and a predictor. The response is assumed to be related to the predictor via a regression model of unknown…

Machine Learning · Statistics 2016-05-19 Carlos Alberto Gomez-Uribe

We suggest two nonparametric approaches, based on kernel methods and orthogonal series to estimating regression functions in the presence of instrumental variables. For the first time in this class of problems, we derive optimal convergence…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Joel L. Horowitz

Nonparametric feature selection in high-dimensional data is an important and challenging problem in statistics and machine learning fields. Most of the existing methods for feature selection focus on parametric or additive models which may…

Methodology · Statistics 2021-03-31 Hang Yu , Yuanjia Wang , Donglin Zeng

We propose Kernel Predictive Control (KPC), a learning-based predictive control strategy that enjoys deterministic guarantees of safety. Noise-corrupted samples of the unknown system dynamics are used to learn several models through the…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Emilio T. Maddalena , Paul Scharnhorst , Yuning Jiang , Colin N. Jones

Kernels are efficient in representing nonlocal dependence and they are widely used to design operators between function spaces. Thus, learning kernels in operators from data is an inverse problem of general interest. Due to the nonlocal…

Machine Learning · Statistics 2024-10-21 Neil K. Chada , Quanjun Lang , Fei Lu , Xiong Wang

In recent years, transfer learning has garnered significant attention. Its ability to leverage knowledge from related studies to improve generalization performance in a target study has made it highly appealing. This paper focuses on…

Machine Learning · Statistics 2025-10-30 Chao Wang , Caixing Wang , Xin He , Xingdong Feng

Physics-informed machine learning combines the expressiveness of data-based approaches with the interpretability of physical models. In this context, we consider a general regression problem where the empirical risk is regularized by a…

Artificial Intelligence · Computer Science 2025-07-15 Nathan Doumèche , Francis Bach , Gérard Biau , Claire Boyer

Kernel methods are fundamental tools in machine learning that allow detection of non-linear dependencies between data without explicitly constructing feature vectors in high dimensional spaces. A major disadvantage of kernel methods is…

Data Structures and Algorithms · Computer Science 2020-12-23 Thomas D. Ahle , Michael Kapralov , Jakob B. T. Knudsen , Rasmus Pagh , Ameya Velingker , David Woodruff , Amir Zandieh

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

Machine Learning · Computer Science 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause

Differential equations are a ubiquitous tool to study dynamics, ranging from physical systems to complex systems, where a large number of agents interact through a graph with non-trivial topological features. Data-driven approximations of…

Statistical Mechanics · Physics 2024-04-26 Vaiva Vasiliauskaite , Nino Antulov-Fantulin

A crucial task in predictive maintenance is estimating the remaining useful life of physical systems. In the last decade, deep learning has improved considerably upon traditional model-based and statistical approaches in terms of predictive…

Machine Learning · Computer Science 2024-02-05 Luca Della Libera , Jacopo Andreoli , Davide Dalle Pezze , Mirco Ravanelli , Gian Antonio Susto

In this paper, we propose a data-adaptive non-parametric kernel learning framework in margin based kernel methods. In model formulation, given an initial kernel matrix, a data-adaptive matrix with two constraints is imposed in an entry-wise…

Machine Learning · Computer Science 2020-10-16 Fanghui Liu , Xiaolin Huang , Chen Gong , Jie Yang , Li Li