English
Related papers

Related papers: Novel Computational Methods for High-Dimensional S…

200 papers

In this work (Part I), we study three time-discretization procedures of the Dynamical Low-Rank Approximation (DLRA) of high-dimensional stochastic differential equations (SDEs). Specifically, we consider the Dynamically Orthogonal (DO)…

Numerical Analysis · Mathematics 2026-01-30 Yoshihito Kazashi , Fabio Nobile , Fabio Zoccolan

We use sensitivity analysis to design bounding-focused discretization (cutting-surface) methods for the global optimization of nonconvex semi-infinite programs (SIPs). We begin by formulating the optimal bounding-focused discretization of…

Optimization and Control · Mathematics 2025-06-24 Evren M. Turan , Johannes Jäschke , Rohit Kannan

In this paper we develop a new data-driven closure approximation method to compute the statistical properties of quantities of interest in high-dimensional stochastic dynamical systems. The new method relies on estimating conditional…

Dynamical Systems · Mathematics 2018-09-26 Catherine Brennan , Daniele Venturi

Stochastic nonlinear dynamical systems can undergo rapid transitions relative to the change in their forcing, for example due to the occurrence of multiple equilibrium solutions for a specific interval of parameters. In this paper, we…

Data Analysis, Statistics and Probability · Physics 2020-11-12 S. Baars , D. Castellana , F. W. Wubs , H. A. Dijkstra

In this paper, we introduce a new stochastic approximation (SA) type algorithm, namely the randomized stochastic gradient (RSG) method, for solving an important class of nonlinear (possibly nonconvex) stochastic programming (SP) problems.…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan

Current Point-based detectors can only learn from the provided points, with limited receptive fields and insufficient global learning capabilities for such targets. In this paper, we present a novel Point Dilation Mechanism for single-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Ao Liang , Haiyang Hua , Jian Fang , Wenyu Chen , Huaici Zhao

Identifying change points (CPs) in a time series is crucial to guide better decision making across various fields like finance and healthcare and facilitating timely responses to potential risks or opportunities. Existing Change Point…

Machine Learning · Computer Science 2023-06-09 Kopal Garg , Jennifer Yu , Tina Behrouzi , Sana Tonekaboni , Anna Goldenberg

We consider (stochastic) convex-concave saddle point (SP) problems with high-dimensional decision variables, arising in various applications including machine learning problems. To contend with the challenges in computing full gradients, we…

Optimization and Control · Mathematics 2025-09-30 Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh , Necdet Serhat Aybat

In the presence of multiscale dynamics in a reaction network, direct simulation methods become inefficient as they can only advance the system on the smallest scale. This work presents stochastic averaging techniques to accelerate…

Probability · Mathematics 2016-03-23 Araz Hashemi , Marcel Nunez , Petr Plechac , Dionisios G. Vlachos

Change-point detection has been a classical problem in statistics and econometrics. This work focuses on the problem of detecting abrupt distributional changes in the data-generating distribution of a sequence of high-dimensional…

Methodology · Statistics 2021-05-20 Shubhadeep Chakraborty , Xianyang Zhang

We propose a new, computationally efficient, sparsity adaptive changepoint estimator for detecting changes in unknown subsets of a high-dimensional data sequence. Assuming the data sequence is Gaussian, we prove that the new method…

Methodology · Statistics 2023-11-27 Per August Jarval Moen , Ingrid Kristine Glad , Martin Tveten

With the rapid expansion in the scale of large language models (LLMs), enabling efficient distributed inference across multiple computing units has become increasingly critical. However, communication overheads from popular distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-03 Han-Byul Kim , Duc Hoang , Arnav Kundu , Mohammad Samragh , Minsik Cho

It is well-known that linearized perturbation methods for sensitivity analysis, such as tangent or adjoint equation-based, finite difference and automatic differentiation are not suitable for turbulent flows. The reason is that turbulent…

Chaotic Dynamics · Physics 2019-07-04 Nisha Chandramoorthy , Qiqi Wang

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

Stochastic Closed-Loop Active Fault Diagnosis (CLAFD) aims to select the input sequentially in order to improve the discrimination of different models by minimizing the predicted error probability. As computation of these error…

Systems and Control · Electrical Eng. & Systems 2024-01-12 Jacques Noom , Oleg Soloviev , Carlas Smith , Michel Verhaegen

Block coordinate descent (BCD) methods and their variants have been widely used in coping with large-scale nonconstrained optimization problems in many fields such as imaging processing, machine learning, compress sensing and so on. For…

Optimization and Control · Mathematics 2018-04-04 Daoli Zhu , Lei Zhao

We propose a method for the approximation of solutions of PDEs with stochastic coefficients based on the direct, i.e., non-adapted, sampling of solutions. This sampling can be done by using any legacy code for the deterministic problem as a…

Numerical Analysis · Mathematics 2015-05-19 Alireza Doostan , Houman Owhadi

An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few…

Methodology · Statistics 2021-09-28 Di Bo , Hoon Hwangbo , Vinit Sharma , Corey Arndt , Stephanie C. TerMaath

Control of nonlinear distributed parameter systems (DPS) under uncertainty is a meaningful task for many industrial processes. However, both intrinsic uncertainty and high dimensionality of DPS require intensive computations, while…

Optimization and Control · Mathematics 2024-10-17 Min Tao , Ioannis Zacharopoulos , Constantinos Theodoropoulos

We use parsimonious diffusion maps (PDMs) to discover the latent dynamics of high-fidelity Navier-Stokes simulations with a focus on the 2D fluidic pinball problem. By varying the Reynolds number, different flow regimes emerge, ranging from…

Fluid Dynamics · Physics 2024-11-05 Alessandro Della Pia , Dimitris Patsatzis , Lucia Russo , Constantinos Siettos