English
Related papers

Related papers: Nonlinear Reduced DNN Models for State Estimation

200 papers

Many DNN-enabled vision applications constantly operate under severe energy constraints such as unmanned aerial vehicles, Augmented Reality headsets, and smartphones. Designing DNNs that can meet a stringent energy budget is becoming…

Machine Learning · Computer Science 2019-04-09 Haichuan Yang , Yuhao Zhu , Ji Liu

Deep structured models are widely used for tasks like semantic segmentation, where explicit correlations between variables provide important prior information which generally helps to reduce the data needs of deep nets. However, current…

Machine Learning · Computer Science 2018-11-02 Colin Graber , Ofer Meshi , Alexander Schwing

This paper is concerned with model order reduction of parametric Partial Differential Equations (PDEs) using tree-based library approximations. Classical approaches are formulated for PDEs on Hilbert spaces and involve one single linear…

Numerical Analysis · Mathematics 2024-04-19 Diane Guignard , Olga Mula

We propose a deep neural network (DNN) based least distance (LD) estimator (DNN-LD) for a multivariate regression problem, addressing the limitations of the conventional methods. Due to the flexibility of a DNN structure, both linear and…

Methodology · Statistics 2024-01-09 Jungmin Shin , Seung Jun Shin , Sungwan Bang

Classical state estimation algorithms rely on predefined target's state-space model, which complicates model derivation and limits adaptability when system dynamics change. Neural network based estimators offer a data-driven alternative,…

Signal Processing · Electrical Eng. & Systems 2025-10-01 Minxing Sun , Li Miao , Qingyu Shen , Yao Mao , Qiliang Bao

Semiparametric statistics play a pivotal role in a wide range of domains, including but not limited to missing data, causal inference, and transfer learning, to name a few. In many settings, semiparametric theory leads to (nearly)…

Machine Learning · Statistics 2024-08-06 Qinshuo Liu , Zixin Wang , Xi-An Li , Xinyao Ji , Lei Zhang , Lin Liu , Zhonghua Liu

Several popular graph embedding techniques for representation learning and dimensionality reduction rely on performing computationally expensive eigendecompositions to derive a nonlinear transformation of the input data space. The resulting…

Machine Learning · Statistics 2016-06-15 Aren Jansen , Gregory Sell , Vince Lyzinski

The measured spatiotemporal response of various physical processes is utilized to infer the governing partial differential equations (PDEs). We propose SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE), a technique…

Machine Learning · Computer Science 2021-09-17 Sutanu Bhowmick , Satish Nagarajaiah

Graphical models have been popularly used for capturing conditional independence structure in multivariate data, which are often built upon independent and identically distributed observations, limiting their applicability to complex…

Methodology · Statistics 2025-07-03 Yuwen Wang , Changyu Liu , Xin He , Junhui Wang

Using a statistical model-based data generation, we develop an experimental setup for the evaluation of neural networks (NNs). The setup helps to benchmark a set of NNs vis-a-vis minimum-mean-square-error (MMSE) performance bounds. This…

Machine Learning · Computer Science 2020-11-19 Sandipan Das , Prakash B. Gohain , Alireza M. Javid , Yonina C. Eldar , Saikat Chatterjee

Dimensionality reduction is essential in simulation-based shape design, where high-dimensional parameterizations hinder optimization, surrogate modeling, and systematic design-space exploration. Parametric Model Embedding (PME) addresses…

Computational Engineering, Finance, and Science · Computer Science 2026-05-13 Andrea Serani , Giorgio Palma , Matteo Diez

This paper presents new methods for set-valued state estimation and active fault diagnosis of linear descriptor systems. The algorithms are based on constrained zonotopes, a generalization of zonotopes capable of describing strongly…

Systems and Control · Electrical Eng. & Systems 2023-04-11 Brenner S. Rego , Davide M. Raimondo , Guilherme V. Raffo

Recurrent neural networks (RNNs) are a vital modeling technique that rely on internal states learned indirectly by optimization of a supervised, unsupervised, or reinforcement training loss. RNNs are used to model dynamic processes that are…

Reduced-order models have long been used to understand the behavior of nonlinear partial differential equations (PDEs). Naturally, reduced-order modeling techniques come at the price of computational accuracy for a decrease in computation…

Numerical Analysis · Mathematics 2023-07-26 Jovan Žigić

This paper introduces Progressively Diffused Networks (PDNs) for unifying multi-scale context modeling with deep feature learning, by taking semantic image segmentation as an exemplar application. Prior neural networks, such as ResNet, tend…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Ruimao Zhang , Wei Yang , Zhanglin Peng , Xiaogang Wang , Liang Lin

Power systems are highly complex, large-scale engineering systems subject to many uncertainties, which makes accurate mathematical modeling challenging. This paper proposes a novel, centralized dynamic state estimator for power systems that…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Milos Katanic , John Lygeros , Gabriela Hug

We propose a neural network based approach for extracting models from dynamic data using ordinary and partial differential equations. In particular, given a time-series or spatio-temporal dataset, we seek to identify an accurate governing…

Machine Learning · Computer Science 2019-08-09 Yifan Sun , Linan Zhang , Hayden Schaeffer

Nonlinear parametric systems have been widely used in modeling nonlinear dynamics in science and engineering. Bifurcation analysis of these nonlinear systems on the parameter space are usually used to study the solution structure such as…

Numerical Analysis · Mathematics 2022-01-26 Wenrui Hao , Chunyue Zheng

With the improvement of the pattern recognition and feature extraction of Deep Neural Networks (DPNNs), image-based design and optimization have been widely used in multidisciplinary researches. Recently, a Reconstructive Neural Network…

Other Computer Science · Computer Science 2019-06-04 Yu Li , Hu Wang , Wenquan Shuai , Honghao Zhang , Yong Peng

The success of deep learning has inspired recent interests in applying neural networks in statistical inference. In this paper, we investigate the use of deep neural networks for nonparametric regression with measurement errors. We propose…

Machine Learning · Statistics 2020-07-16 Zhirui Hu , Zheng Tracy Ke , Jun S Liu