English
Related papers

Related papers: Optimal model order reduction with the Steiglitz-M…

200 papers

High-order ARX models can be used to approximate a quite general class of linear systems in a parametric model structure, and well-established methods can then be used to retrieve the true plant and noise models from the ARX polynomials.…

Systems and Control · Computer Science 2016-09-16 Miguel Galrinho , Niklas Everitt , Håkan Hjalmarsson

In this paper, we study the problem of learning multi-dimensional Gaussian Mixture Models (GMMs), with a specific focus on model order selection and efficient mixing distribution estimation. We first establish an information-theoretic lower…

Machine Learning · Statistics 2026-03-23 Xinyu Liu , Hai Zhang

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

Theory and methods to obtain parametric reduced-order models by moment matching are presented. The definition of the parametric moment is introduced, and methods (model-based and data-driven) for the approximation of the parametric moment…

Systems and Control · Electrical Eng. & Systems 2025-06-13 Hanqing Zhang , Junyu Mao , Mohammad Fahim Shakib , Giordano Scarciotti

In the problem of model selection for a given family of linear estimators, ordered by their variance, we offer a new "smallest accepted" approach motivated by Lepski's method and multiple testing theory. The procedure selects the smallest…

Statistics Theory · Mathematics 2015-07-20 Vladimir Spokoiny , Niklas Willrich

Mapping near-field pollutant concentration is essential to track accidental toxic plume dispersion in urban areas. By solving a large part of the turbulence spectrum, large-eddy simulations (LES) have the potential to accurately represent…

Machine Learning · Statistics 2022-08-03 Bastien X Nony , Mélanie Rochoux , Thomas Jaravel , Didier Lucor

Depending on the frequency range of interest, finite element-based modeling of acoustic problems leads to dynamical systems with very high dimensional state spaces. As these models can mostly be described with second order linear dynamical…

Numerical Analysis · Mathematics 2024-12-17 Siyang Hu , Nick Wulbusch , Alexey Chernov , Tamara Bechtold

Implicit numerical integration of nonlinear ODEs requires solving a system of nonlinear algebraic equations at each time step. Each of these systems is often solved by a Newton-like method, which incurs a sequence of linear-system solves.…

Numerical Analysis · Mathematics 2014-10-24 Kevin Carlberg , Jaideep Ray , Bart van Bloemen Waanders

This paper studies empirical risk minimization (ERM) problems for large-scale datasets and incorporates the idea of adaptive sample size methods to improve the guaranteed convergence bounds for first-order stochastic and deterministic…

Machine Learning · Computer Science 2017-09-05 Aryan Mokhtari , Alejandro Ribeiro

The aim of this paper is to propose a new data-driven control scheme for multi-input-multi-output linear time-invariant systems whose system model are completely unknown. Using a non-minimal input-output realization, the proposed method can…

Systems and Control · Electrical Eng. & Systems 2022-01-11 Nam H. Jo , Hyungbo Shim

A variety of wireless channel estimation methods, e.g., MUSIC and ESPRIT, rely on prior knowledge of the model order. Therefore, it is important to correctly estimate the number of multipath components (MPCs) which compose such channels.…

Signal Processing · Electrical Eng. & Systems 2021-06-23 Brenda Vilas Boas , Wolfgang Zirwas , Martin Haardt

Model order reduction aims to determine a low-order approximation of high-order models with least possible approximation errors. For application to physical systems, it is crucial that the reduced order model (ROM) is robust to any…

Systems and Control · Electrical Eng. & Systems 2025-05-05 Shivam Bajaj , Carolyn L. Beck , Vijay Gupta

This paper presents a structure-exploiting nonlinear model reduction method for systems with general nonlinearities. First, the nonlinear model is lifted to a model with more structure via variable transformations and the introduction of…

Numerical Analysis · Computer Science 2019-07-30 Boris Kramer , Karen Willcox

A key issue in statistics and machine learning is to automatically select the "right" model complexity, e.g., the number of neighbors to be averaged over in k nearest neighbor (kNN) regression or the polynomial degree in regression with…

Machine Learning · Computer Science 2010-10-04 Marcus Hutter , Minh-Ngoc Tran

Top-down induction of decision trees has been observed to suffer from the inadequate functioning of the pruning phase. In particular, it is known that the size of the resulting tree grows linearly with the sample size, even though the…

Artificial Intelligence · Computer Science 2011-06-06 T. Elomaa , M. Kaariainen

In this paper, a practicable simulation-free model order reduction method by nonlinear moment matching is developed. Based on the steady-state interpretation of linear moment matching, we comprehensively explain the extension of this…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Maria Cruz Varona , Raphael Gebhart , Julian Suk , Boris Lohmann

It was recently shown [7, 9] that "properly built" linear and polyhedral estimates nearly attain minimax accuracy bounds in the problem of recovery of unknown signal from noisy observations of linear images of the signal when the signal set…

Optimization and Control · Mathematics 2023-12-25 Yannis Bekri , Anatoli Juditsky , Arkadi Nemirovski

A non-intrusive reduced order model based on convolutional autoencoders (NIROM-CAEs) is proposed as a data-driven tool to build an efficient nonlinear reduced-order model for stochastic spatio-temporal large-scale physical problems. The…

Fluid Dynamics · Physics 2022-08-08 Azzedine Abdedou , Azzeddine Soulaïmani

Model mismatch and process noise are two frequently occurring phenomena that can drastically affect the performance of model predictive control (MPC) in practical applications. We propose a principled way to tune the cost function and the…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Riccardo Zuliani , Efe C. Balta , John Lygeros

We present an adaptive sampling strategy for the optimization-based structure preserving model order reduction (MOR) algorithm developed in [Schwerdtner, P. and Voigt, M. (2020). Structure preserving model order reduction by parameter…

Systems and Control · Electrical Eng. & Systems 2021-06-23 Paul Schwerdtner , Matthias Voigt