English
Related papers

Related papers: Optimal model order reduction with the Steiglitz-M…

200 papers

We consider a class of statistical estimation problems in which we are given a random data matrix ${\boldsymbol X}\in {\mathbb R}^{n\times d}$ (and possibly some labels ${\boldsymbol y}\in{\mathbb R}^n$) and would like to estimate a…

Computation · Statistics 2022-01-14 Andrea Montanari , Yuchen Wu

We provide improved convergence rates for various \emph{non-smooth} optimization problems via higher-order accelerated methods. In the case of $\ell_\infty$ regression, we achieves an $O(\epsilon^{-4/5})$ iteration complexity, breaking the…

Optimization and Control · Mathematics 2019-06-05 Brian Bullins , Richard Peng

This work explores multi-modal inference in a high-dimensional simplified model, analytically quantifying the performance gain of multi-modal inference over that of analyzing modalities in isolation. We present the Bayes-optimal performance…

Machine Learning · Statistics 2025-09-30 Christian Keup , Lenka Zdeborová

Clinical oriented applications of computational electrocardiology require efficient and reliable identification of patient-specific parameters of mathematical models based on available measures. In particular, the estimation of cardiac…

Numerical Analysis · Mathematics 2016-11-01 Huanhuan Yang , Alessandro Veneziani

In power distribution systems, the growing penetration of renewable energy resources brings new challenges to maintaining voltage safety, which is further complicated by the limited model information of distribution systems. To address…

Optimization and Control · Mathematics 2021-03-30 Xin Chen , Jorge I. Poveda , Na Li

Numerical simulations for flow and transport in subsurface porous media often prove computationally prohibitive due to property data availability at multiple spatial scales that can vary by orders of magnitude. A number of model order…

Numerical Analysis · Mathematics 2018-03-13 Gurpreet Singh , Wingtat Leung , Mary F. Wheeler

Many real-world decision making tasks require us to choose among several expensive observations. In a sensor network, for example, it is important to select the subset of sensors that is expected to provide the strongest reduction in…

Artificial Intelligence · Computer Science 2014-01-16 Andreas Krause , Carlos Guestrin

In this paper we propose local approximation spaces for localized model order reduction procedures such as domain decomposition and multiscale methods. Those spaces are constructed from local solutions of the partial differential equation…

Numerical Analysis · Mathematics 2018-07-31 Andreas Buhr , Kathrin Smetana

This paper presents a model order reduction (MOR) approach for high dimensional problems in the analysis of financial risk. To understand the financial risks and possible outcomes, we have to perform several thousand simulations of the…

Computational Finance · Quantitative Finance 2021-06-15 Andreas Binder , Onkar Jadhav , Volker Mehrmann

Matrix completion has been well studied under the uniform sampling model and the trace-norm regularized methods perform well both theoretically and numerically in such a setting. However, the uniform sampling model is unrealistic for a…

Machine Learning · Computer Science 2017-05-01 T. Tony Cai , Wen-Xin Zhou

In dynamical system theory, the process of obtaining a reduced-order approximation of the high-order model is called model order reduction. The closeness of the reduced-order model to the original model is generally gauged by using system…

Systems and Control · Electrical Eng. & Systems 2023-03-07 Umair Zulfiqar , Xin Dua , Qiuyan Song , Muwahida Liaquat , Victor Sreeram

While many acoustic systems are well-modelled by linear time-invariant dynamical systems, high-fidelity models often become computationally expensive due the complexity of dynamics. Reduced order modelling techniques, such as the…

Dynamical Systems · Mathematics 2025-06-11 Art J. R. Pelling , Ennes Sarradj

An important class of dynamical systems with several practical applications is linear systems with quadratic outputs. These models have the same state equation as standard linear time-invariant systems but differ in their output equations,…

Systems and Control · Electrical Eng. & Systems 2024-08-13 Umair Zulfiqar , Zhi-Hua Xiao , Qiu-Yan Song , Mohammad Monir Uddin , Victor Sreeram

Motivated by applications in machine learning and operations research, we study regret minimization with stochastic first-order oracle feedback in online constrained, and possibly non-smooth, non-convex problems. In this setting, the…

Machine Learning · Computer Science 2020-10-14 Nadav Hallak , Panayotis Mertikopoulos , Volkan Cevher

Offline model-based optimization (MBO) aims to identify a design that maximizes a black-box function using only a fixed, pre-collected dataset of designs and their corresponding scores. A common approach in offline MBO is to train a…

Machine Learning · Computer Science 2025-05-05 Rong-Xi Tan , Ke Xue , Shen-Huan Lyu , Haopu Shang , Yao Wang , Yaoyuan Wang , Sheng Fu , Chao Qian

Optimization in engineering requires appropriate models. In this article, a regression method for enhancing the predictive power of a model by exploiting expert knowledge in the form of shape constraints, or more specifically, monotonicity…

Many recent studies on first-order methods (FOMs) focus on \emph{composite non-convex non-smooth} optimization with linear and/or nonlinear function constraints. Upper (or worst-case) complexity bounds have been established for these…

Optimization and Control · Mathematics 2025-05-14 Wei Liu , Qihang Lin , Yangyang Xu

Non-orthogonal multiple access (NOMA) technique has sparked a growing research interest due to its ability to enhance the overall spectral efficiency of wireless systems. In this paper, we investigate the pairwise error probability (PEP)…

Signal Processing · Electrical Eng. & Systems 2018-04-12 Lina Bariah , Arafat Al-Dweik , Sami Muhaidat

The goal of ordinal embedding is to represent items as points in a low-dimensional Euclidean space given a set of constraints in the form of distance comparisons like "item $i$ is closer to item $j$ than item $k$". Ordinal constraints like…

Machine Learning · Statistics 2016-06-24 Lalit Jain , Kevin Jamieson , Robert Nowak

Regularization is essential for avoiding over-fitting to training data in network optimization, leading to better generalization of the trained networks. The label noise provides a strong implicit regularization by replacing the target…

Machine Learning · Computer Science 2022-05-04 Kensuke Nakamura , Bong-Soo Sohn , Kyoung-Jae Won , Byung-Woo Hong