English
Related papers

Related papers: Least Squares Model Reduction: A Two-Stage System-…

200 papers

Regression analysis is an important instrument to determine the effect of the explanatory variables on response variables. When outliers and bias errors are present, the standard weighted least squares estimator may perform poorly. For this…

Computation · Statistics 2025-02-11 Justo Puerto , Alberto Torrejon

A standard approach to reduced-order modeling of higher-order linear dynamical systems is to rewrite the system as an equivalent first-order system and then employ Krylov-subspace techniques for reduced-order modeling of first-order…

Numerical Analysis · Mathematics 2007-05-23 Roland W. Freund

Model order reduction seeks to approximate large-scale dynamical systems by lower-dimensional reduced models. For linear systems, a small reduced dimension directly translates into low computational cost, ensuring online efficiency. This…

Numerical Analysis · Mathematics 2025-12-17 Björn Liljegren-Sailer

The root mean squared error is an important measure used in a variety of applications such as structural dynamics and acoustics to model averaged deviations from standard behavior. For large-scale systems, simulations of this quantity…

Numerical Analysis · Mathematics 2025-04-22 Sean Reiter , Steffen W. R. Werner

The paper studies a geometrically robust least-squares problem that extends classical and norm-based robust formulations. Rather than minimizing residual error for fixed or perturbed data, we interpret least-squares as enforcing approximate…

Optimization and Control · Mathematics 2026-04-28 Shreyas Bharadwaj , Bamdev Mishra , Cyrus Mostajeran , Alberto Padoan , Jeremy Coulson , Ravi N. Banavar

A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its "black box" aspect, many researchers refuse to use it. Moreover, the optimization (often based on the…

Neural and Evolutionary Computing · Computer Science 2015-06-16 Cyril Voyant , Wani W. Tamas , Christophe Paoli , Aurélia Balu , Marc Muselli , Marie Laure Nivet , Gilles Notton

This paper deals with tactics for fast computation in least squares regression in high dimensions. These tactics include: (a) the majorization-minimization (MM) principle, (b) smoothing by Moreau envelopes, and (c) the proximal distance…

Computation · Statistics 2026-05-19 Qiang Heng , Hua Zhou , Kenneth Lange

In large-scale data processing scenarios, data often arrive in sequential streams generated by complex systems that exhibit drifting distributions and time-varying system parameters. This nonstationarity challenges theoretical analysis, as…

Machine Learning · Computer Science 2026-02-13 Yifei Jin , Xin Zheng , Lei Guo

This paper provides an alternative to penalized estimators for estimation and vari- able selection in high dimensional linear regression models with measurement error or missing covariates. We propose estimation via bias corrected least…

Methodology · Statistics 2016-05-11 Abhishek Kaul , Hira L. Koul , Akshita Chawla , Soumendra N. Lahiri

Model order reduction in high-dimensional, nonlinear dynamical systems if often enabled through fast-slow timescale separation. One such approach involves identifying a low-dimensional slow manifold to which the state rapidly converges and…

Dynamical Systems · Mathematics 2026-05-14 Dan Wilson

In time-limited model order reduction, a reduced-order approximation of the original high-order model is obtained that accurately approximates the original model within the desired limited time interval. Accuracy outside that time interval…

Systems and Control · Electrical Eng. & Systems 2022-12-19 Umair Zulfiqar , Xin Du , Qiuyan Song , Zhi-Hua Xiao , Victor Sreeram

Modellers of complex biological or social systems are often faced with an invidious choice: to use simple models with few mechanisms that can be fully analysed, or to construct complicated models that include all the features which are…

Physics and Society · Physics 2016-09-28 Luis F. Lafuerza , Louise Dyson , Bruce Edmonds , Alan J. McKane

In this paper, a model reduction procedure for a network of interconnected identical passive subsystems is presented. Here, rather than performing model reduction on the subsystems, adjacent subsystems are clustered, leading to a…

Systems and Control · Computer Science 2014-04-29 Bart Besselink , Henrik Sandberg , Karl Henrik Johansson

In this brief paper, we propose a time-domain data-driven method for model order reduction by two-sided moment matching for linear systems. An algorithm that asymptotically approximates the matrix product $\Upsilon \Pi$ from time-domain…

Systems and Control · Electrical Eng. & Systems 2022-12-19 Junyu Mao , Giordano Scarciotti

A new closed-form solver is proposed minimizing the algebraic error optimally, in the least-squares sense, to estimate the relative planar motion of two calibrated cameras. The main objective is to solve the over-determined case, i.e., when…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Levente Hajder , Daniel Barath

Robust optimization typically follows a worst-case perspective, where a single scenario may determine the objective value of a given solution. Accordingly, it is a challenging task to reduce the size of an uncertainty set without changing…

Optimization and Control · Mathematics 2022-09-02 Marc Goerigk , Mohammad Khosravi

This work presents a model reduction approach to the inverse problem in the application of subsurface flows. For the Bayesian inverse problem, the forward model needs to be repeatedly computed for a large number of samples to get a…

Numerical Analysis · Mathematics 2016-04-04 Lijian Jiang , Na Ou

The randomized row method is a popular representative of the iterative algorithm because of its efficiency in solving the overdetermined and consistent systems of linear equations. In this paper, we present an extended randomized multiple…

Numerical Analysis · Mathematics 2024-11-06 Nian-Ci Wu , Chengzhi Liu , Yatian Wang , Qian Zuo

Least-squares refitting is widely used in high dimensional regression to reduce the prediction bias of l1-penalized estimators (e.g., Lasso and Square-Root Lasso). We present theoretical and numerical results that provide new insights into…

Methodology · Statistics 2013-06-04 Johannes Lederer

This paper considers the creation of parametric surrogate models for applications in science and engineering where the goal is to predict high-dimensional spatiotemporal output quantities of interest, such as pressure, temperature and…

Computational Physics · Physics 2022-03-24 Chi Hoang , Kenny Chowdhary , Kookjin Lee , Jaideep Ray