English
Related papers

Related papers: Statistical efficiency of structured cpd estimatio…

200 papers

Principal Component Analysis (PCA) finds a linear mapping and maximizes the variance of the data which makes PCA sensitive to outliers and may cause wrong eigendirection. In this paper, we propose techniques to solve this problem; we use…

Artificial Intelligence · Computer Science 2012-07-03 Peratham Wiriyathammabhum , Boonserm Kijsirikul

Volterra series are especially useful for nonlinear system identification, also thanks to their capability to approximate a broad range of input-output maps. However, their identification from a finite set of data is hard, due to the curse…

Machine Learning · Computer Science 2019-11-13 Alberto Dalla Libera , Ruggero Carli , Gianluigi Pillonetto

We consider the problem of identifying a parallel Wiener-Hammerstein structure from Volterra kernels. Methods based on Volterra kernels typically resort to coupled tensor decompositions of the kernels. However, in the case of parallel…

Signal Processing · Electrical Eng. & Systems 2021-09-21 Konstantin Usevich , Philippe Dreesen , Mariya Ishteva

This paper presents a Cramer-Rao lower bound (CRLB) on the variance of unbiased estimates of factor matrices in Canonical Polyadic (CP) or CANDECOMP/PARAFAC (CP) decompositions of a tensor from noisy observations, (i.e., the tensor plus a…

Other Statistics · Statistics 2014-02-10 Petr Tichavsky , Anh Huy Phan , Zbynek Koldovsky

Learning models of dynamical systems characterized by specific stability properties is of crucial importance in applications. Existing results mainly focus on linear systems or some limited classes of nonlinear systems and stability…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Matteo Scandella , Michelangelo Bin , Thomas Parisini

Probabilistic Manifold Decomposition (PMD)\cite{doi:10.1137/25M1738863}, developed in our earlier work, provides a nonlinear model reduction by embedding high-dimensional dynamics onto low-dimensional probabilistic manifolds. The PMD has…

Numerical Analysis · Mathematics 2026-01-13 Jiaming Guo , Dunhui Xiao

Tensor decomposition is a well-known tool for multiway data analysis. This work proposes using stochastic gradients for efficient generalized canonical polyadic (GCP) tensor decomposition of large-scale tensors. GCP tensor decomposition is…

Numerical Analysis · Mathematics 2020-11-25 Tamara G. Kolda , David Hong

This paper introduces a method for the nonparametric Bayesian learning of nonlinear operators, through the use of the Volterra series with kernels represented using Gaussian processes (GPs), which we term the nonparametric Volterra kernels…

Machine Learning · Statistics 2021-06-11 Magnus Ross , Michael T. Smith , Mauricio A. Álvarez

In this paper, we deal with nonparametric regression for circular data, meaning that observations are represented by points lying on the unit circle. We propose a kernel estimation procedure with data-driven selection of the bandwidth…

Statistics Theory · Mathematics 2023-07-03 Tien Dat Nguyen , Thanh Mai Pham Ngoc , Vincent Rivoirard

The identification of structured state-space model has been intensively studied for a long time but still has not been adequately addressed. The main challenge is that the involved estimation problem is a non-convex (or bilinear)…

Optimization and Control · Mathematics 2016-11-15 Chengpu Yu , Michel Verhaegen , Shahar Kovalsky , Ronen Basri

This paper presents a new algorithm for set-based state estimation of nonlinear discrete-time systems with bounded uncertainties. The novel method builds upon essential properties and computational advantages of constrained zonotopes (CZs)…

Systems and Control · Electrical Eng. & Systems 2025-04-02 Brenner S. Rego , Guilherme V. Raffo , Marco H. Terra , Joseph K. Scott

In this paper, a numerical method is proposed for canonical polyadic (CP) decomposition of small size tensors. The focus is primarily on decomposition of tensors that correspond to small matrix multiplications. Here, rank of the tensors is…

Numerical Analysis · Mathematics 2016-03-07 Petr Tichavsky , Anh Huy Phan , Andrzej Cichocki

We consider efficient estimation of the Euclidean parameters in a generalized partially linear additive models for longitudinal/clustered data when multiple covariates need to be modeled nonparametrically, and propose an estimation…

Statistics Theory · Mathematics 2014-02-05 Guang Cheng , Lan Zhou , Jianhua Z. Huang

This paper proposes a novel Kernelized Data-Driven Predictive Control (KDPC) scheme for robust, offset-free tracking of nonlinear systems. Our computationally efficient hybrid approach separates the prediction: (1) kernel ridge regression…

Systems and Control · Electrical Eng. & Systems 2026-01-26 Mahmood Mazare , Hossein Ramezani

In general, algorithms for order-3 CANDECOMP/-PARAFAC (CP), also coined canonical polyadic decomposition (CPD), are easily to implement and can be extended to higher order CPD. Unfortunately, the algorithms become computationally demanding,…

Numerical Analysis · Mathematics 2017-04-26 Anh Huy Phan , Petr Tichavsky , Andrzej Cichocki

In this note, we propose a framework for proving computational lower bounds in norm approximation by leveraging a reverse detection--estimation gap. The starting point is a testing problem together with an estimator whose error is…

Statistics Theory · Mathematics 2026-04-07 Runshi Tang , Yuefeng Han , Anru R. Zhang

We introduce a data-based approach to estimating key quantities which arise in the study of nonlinear control systems and random nonlinear dynamical systems. Our approach hinges on the observation that much of the existing linear theory may…

Optimization and Control · Mathematics 2016-04-04 Jake Bouvrie , Boumediene Hamzi

In this paper, we propose a new randomized method for numerical integration on a compact complex manifold with respect to a continuous volume form. Taking for quadrature nodes a suitable determinantal point process, we build an unbiased…

Complex Variables · Mathematics 2024-05-16 Thibaut Lemoine , Rémi Bardenet

Optimization techniques play a crucial role in estimating parameters and state information for nonlinear systems. However, some critical aspects of these problems have received little attention in previous research. In this paper, we…

Optimization and Control · Mathematics 2023-06-02 Kaushal Kumar

The paper considers nonparametric kernel density/regression estimation from a stochastic optimization point of view. The estimation problem is represented through a family of stochastic optimization problems. Recursive constrained…

Statistics Theory · Mathematics 2024-09-05 Vladimir Norkin , Vladimir Kirilyuk