English
Related papers

Related papers: Consistency of support vector machines for forecas…

200 papers

We consider the convolution model where i.i.d. random variables $X_i$ having unknown density $f$ are observed with additive i.i.d. noise, independent of the $X$'s. We assume that the density $f$ belongs to either a Sobolev class or a class…

Statistics Theory · Mathematics 2009-09-29 Cristina Butucea

The complexity of glasses makes it challenging to explain their dynamics. Machine Learning (ML) has emerged as a promising pathway for understanding glassy dynamics by linking their structural features to rearrangement dynamics. Support…

Soft Condensed Matter · Physics 2025-02-11 Arabind Swain , Sean Alexander Ridout , Ilya Nemenman

We propose a new method for blind system identification. Resorting to a Gaussian regression framework, we model the impulse response of the unknown linear system as a realization of a Gaussian process. The structure of the covariance matrix…

Systems and Control · Computer Science 2016-05-20 Giulio Bottegal , Riccardo S. Risuleo , Håkan Hjalmarsson

We study the problem of learning an unknown mixture of $k$ rankings over $n$ elements, given access to noisy samples drawn from the unknown mixture. We consider a range of different noise models, including natural variants of the "heat…

Machine Learning · Computer Science 2018-11-06 Anindya De , Ryan O'Donnell , Rocco Servedio

Variational autoencoders (VAEs) have been used extensively to discover low-dimensional latent factors governing neural activity and animal behavior. However, without careful model selection, the uncovered latent factors may reflect noise in…

Machine Learning · Computer Science 2023-12-13 Julia Huiming Wang , Dexter Tsin , Tatiana Engel

Nearly all identifiability results in unsupervised representation learning inspired by, e.g., independent component analysis, factor analysis, and causal representation learning, rely on assumptions of additive independent noise or…

Machine Learning · Computer Science 2025-03-24 Yujia Zheng , Yang Liu , Jiaxiong Yao , Yingyao Hu , Kun Zhang

In this paper, we propose a novel bounded asymmetric elastic net ($L_{baen}$) loss function and combine it with the support vector machine (SVM), resulting in the BAEN-SVM. The $L_{baen}$ is bounded and asymmetric and can degrade to the…

Machine Learning · Statistics 2026-04-09 Haiyan Du , Hu Yang

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along…

Methodology · Statistics 2022-01-27 Christos Merkatas , Simo Särkkä

The parameters of support vector machines (SVMs) such as the penalty parameter and the kernel parameters have a great impact on the classification accuracy and the complexity of the SVM model. Therefore, the model selection in SVM involves…

Machine Learning · Computer Science 2020-07-13 Alaa Tharwat

We present a noise guided trajectory based system identification method for inferring the dynamical structure from observation generated by stochastic differential equations. Our method can handle various kinds of noise, including the case…

Numerical Analysis · Mathematics 2024-03-06 Ziheng Guo , Igor Cialenco , Ming Zhong

This paper is devoted to the estimation of the shift parameter in a semiparametric regression model when the distribution of the observation times is unknown. Hence, we propose to use a stochastic algorithm which takes into account the…

Statistics Theory · Mathematics 2013-12-23 Philippe Fraysse

We consider stationary stochastic dynamical systems evolving on a compact metric space, by perturbing a deterministic dynamics with a random noise, added according to an arbitrary probabilistic distribution. We prove the maximal and…

Dynamical Systems · Mathematics 2018-07-10 Eleonora Catsigeras

We consider the estimation of an n-dimensional vector s from the noisy element-wise measurements of $\mathbf{s}\mathbf{s}^T$, a generic problem that arises in statistics and machine learning. We study a mismatched Bayesian inference…

Information Theory · Computer Science 2021-09-14 Farzad Pourkamali , Nicolas Macris

Support Vector Machines (SVMs) with various kernels have played dominant role in machine learning for many years, finding numerous applications. Although they have many attractive features interpretation of their solutions is quite…

Machine Learning · Computer Science 2019-01-29 Tomasz Maszczyk , Włodzisław Duch

This paper considers learning the hidden causal network of a linear networked dynamical system (NDS) from the time series data at some of its nodes -- partial observability. The dynamics of the NDS are driven by colored noise that generates…

Machine Learning · Computer Science 2024-02-13 Augusto Santos , Diogo Rente , Rui Seabra , José M. F. Moura

The stochastic processes underlying the growth and stability of biological and psychological systems reveal themselves when far from equilibrium. Far from equilibrium, nonergodicity reigns. Nonergodicity implies that the average outcome for…

Methodology · Statistics 2022-02-03 Madhur Mangalam , Damian G. Kelty-Stephen

This paper deals with the identification of linear stochastic dynamical systems, where the unknowns include system coefficients and noise variances. Conventional approaches that rely on the maximum likelihood estimation (MLE) require…

Machine Learning · Statistics 2025-08-18 Jinwen Xu , Qin Lu , Yaakov Bar-Shalom

In this paper, we investigate the inconsistency problem arising from observability mismatch that frequently occurs in nonlinear systems such as multi-robot cooperative localization and simultaneous localization and mapping. For a general…

Robotics · Computer Science 2025-02-10 Ning Hao , Chungeng Tian , Fenghua He

This paper proposes a statistical verification framework using Gaussian processes (GPs) for simulation-based verification of stochastic nonlinear systems with parametric uncertainties. Given a small number of stochastic simulations, the…

Systems and Control · Computer Science 2017-10-03 John F. Quindlen , Ufuk Topcu , Girish Chowdhary , Jonathan P. How

Modeling car-following behavior is fundamental to microscopic traffic simulation, yet traditional deterministic models often fail to capture the full extent of variability and unpredictability in human driving. While many modern approaches…

Applications · Statistics 2026-01-30 Chengyuan Zhang , Zhengbing He , Cathy Wu , Lijun Sun