English
Related papers

Related papers: Analytic regularity and stochastic collocation of …

200 papers

Modern statistical inference tasks often require iterative optimization methods to compute the solution. Convergence analysis from an optimization viewpoint only informs us how well the solution is approximated numerically but overlooks the…

Machine Learning · Statistics 2020-07-27 Tengyuan Liang , Weijie Su

Researchers have proposed several approaches for neural network (NN) based uncertainty quantification (UQ). However, most of the approaches are developed considering strong assumptions. Uncertainty quantification algorithms often perform…

Motivated by applications arising from large scale optimization and machine learning, we consider stochastic quasi-Newton (SQN) methods for solving unconstrained convex optimization problems. The convergence analysis of the SQN methods,…

Optimization and Control · Mathematics 2019-10-02 Farzad Yousefian , Angelia Nedić , Uday Shanbhag

A particularly challenging problem in AI safety is providing guarantees on the behavior of high-dimensional autonomous systems. Verification approaches centered around reachability analysis fail to scale, and purely statistical approaches…

Artificial Intelligence · Computer Science 2025-03-11 Souradeep Dutta , Michele Caprio , Vivian Lin , Matthew Cleaveland , Kuk Jin Jang , Ivan Ruchkin , Oleg Sokolsky , Insup Lee

In this paper, we develop a novel contraction framework for stability analysis of discrete-time nonlinear systems with parameters following stochastic processes. For general stochastic processes, we first provide a sufficient condition for…

Systems and Control · Electrical Eng. & Systems 2021-06-11 Yu Kawano , Yohei Hosoe

This paper is concerned with a lesser-studied problem in the context of model-based, uncertainty quantification (UQ), that of optimization/design/control under uncertainty. The solution of such problems is hindered not only by the usual…

Computation · Statistics 2016-02-17 Phaedon-Stelios Koutsourelakis

Uncertainty Quantification (UQ) is a booming discipline for complex computational models based on the analysis of robustness, reliability and credibility. UQ analysis for nonlinear crash models with high dimensional outputs presents…

Computational Engineering, Finance, and Science · Computer Science 2021-03-31 Marc Rocas , Alberto García-González , Xabier Larrayoz , Pedro Díez

In this work we describe an Adaptive Regularization using Cubics (ARC) method for large-scale nonconvex unconstrained optimization using Limited-memory Quasi-Newton (LQN) matrices. ARC methods are a relatively new family of optimization…

Optimization and Control · Mathematics 2022-04-21 Jarad Forristal , Joshua Griffin , Wenwen Zhou , Seyedalireza Yektamaram

Recently, the graph-accelerated non-intrusive polynomial chaos (NIPC) method has been proposed for solving uncertainty quantification (UQ) problems. This method leverages the full-grid integration-based NIPC method to address UQ problems…

Computational Engineering, Finance, and Science · Computer Science 2024-10-17 Bingran Wang , Nicholas C. Orndorff , John T. Hwang

We present an enriched formulation of the Least Squares (LSQ) regression method for Uncertainty Quantification (UQ) using generalised polynomial chaos (gPC). More specifically, we enrich the linear system with additional equations for the…

Numerical Analysis · Mathematics 2023-08-09 Kyriakos D. Kantarakias , George Papadakis

Stochastic spectral methods have achieved great success in the uncertainty quantification of many engineering problems, including electronic and photonic integrated circuits influenced by fabrication process variations. Existing techniques…

Numerical Analysis · Mathematics 2018-12-06 Chunfeng Cui , Zheng Zhang

In this paper, we present an adaptive algorithm to construct response surface approximations of high-fidelity models using a hierarchy of lower fidelity models. Our algorithm is based on multi-index stochastic collocation and automatically…

Numerical Analysis · Mathematics 2021-05-04 John D. Jakeman , Michael Eldred , Gianluca Geraci , Alex Gorodetsky

Turbulent dynamical systems characterized by both a high-dimensional phase space and a large number of instabilities are ubiquitous among many complex systems in science and engineering. The existence of a strange attractor in the turbulent…

Fluid Dynamics · Physics 2018-02-23 Andrew J. Majda , Di Qi

Non-spherical particles transported by an anisotropic turbulent flow preferentially align with the mean shear and intermittently tumble when the local strain fluctuates. Such an intricate behaviour is here studied for inertialess,…

Soft Condensed Matter · Physics 2022-12-27 Lorenzo Campana , Mireille Bossy , Jeremie Bec

This paper builds Wasserstein ambiguity sets for the unknown probability distribution of dynamic random variables leveraging noisy partial-state observations. The constructed ambiguity sets contain the true distribution of the data with…

Optimization and Control · Mathematics 2021-07-21 Dimitris Boskos , Jorge Cortés , Sonia Martínez

We present a novel statistical inference framework for convex empirical risk minimization, using approximate stochastic Newton steps. The proposed algorithm is based on the notion of finite differences and allows the approximation of a…

Machine Learning · Computer Science 2019-02-06 Tianyang Li , Anastasios Kyrillidis , Liu Liu , Constantine Caramanis

We present a first analysis of a nonperturbative approach to quantum gravity based on a representation of quantum field theory in terms of stochastic processes. The stochastic description accommodates a physical Lorentz-invariant…

General Relativity and Quantum Cosmology · Physics 2022-08-23 Joshua Erlich

We study a sparse negative binomial regression (NBR) for count data by showing the non-asymptotic advantages of using the elastic-net estimator. Two types of oracle inequalities are derived for the NBR's elastic-net estimates by using the…

Machine Learning · Statistics 2022-01-11 Huiming Zhang , Jinzhu Jia

This paper studies the sample complexity of the stochastic Linear Quadratic Regulator when applied to systems with multiplicative noise. We assume that the covariance of the noise is unknown and estimate it using the sample covariance,…

Systems and Control · Electrical Eng. & Systems 2021-03-05 Peter Coppens , Panagiotis Patrinos

Stochasticity plays a significant role in the low-power operation of a biological neural network. In an artificial neural network (ANN), stochasticity also contributes to critical functions such as the uncertainty quantification (UQ) for…

Applied Physics · Physics 2023-10-17 Cen Wang , Guang Zeng , Xinyu Wen , Yuhui He , Wei Luo , Shiwei Chen , Shiheng Liang , Yue Zhang