English
Related papers

Related papers: Second-order adjoint sensitivity analysis procedur…

200 papers

Standard Operating Procedures (SOPs) are critical for enterprise operations, yet existing language models struggle with SOP understanding and cross-domain generalization. Current methods fail because joint training cannot differentiate…

Computation and Language · Computer Science 2026-02-11 Siyuan Huang , Ziyu Wang , Chao Pan , Han Zhao

Finding an approximate second-order stationary point (SOSP) is a well-studied and fundamental problem in stochastic nonconvex optimization with many applications in machine learning. However, this problem is poorly understood in the…

Optimization and Control · Mathematics 2024-03-19 Shuyao Li , Yu Cheng , Ilias Diakonikolas , Jelena Diakonikolas , Rong Ge , Stephen J. Wright

Statistical preconditioning enables fast methods for distributed large-scale empirical risk minimization problems. In this approach, multiple worker nodes compute gradients in parallel, which are then used by the central node to update the…

Sensitivity analysis, especially adjoint based sensitivity analysis, is a powerful tool for engineering design which allows for the efficient computation of sensitivities with respect to many parameters. However, these methods break down…

Dynamical Systems · Mathematics 2015-06-16 Patrick Blonigan , Qiqi Wang

Derivatives of differential equation solutions are commonly for parameter estimation, fitting neural differential equations, and as model diagnostics. However, with a litany of choices and a Cartesian product of potential methods, it can be…

Numerical Analysis · Computer Science 2021-07-21 Yingbo Ma , Vaibhav Dixit , Mike Innes , Xingjian Guo , Christopher Rackauckas

Learning graphical causal structures from time series data presents significant challenges, especially when the measurement frequency does not match the causal timescale of the system. This often leads to a set of equally possible…

Machine Learning · Computer Science 2025-06-12 Mohammadsajad Abavisani , Kseniya Solovyeva , David Danks , Vince Calhoun , Sergey Plis

Many atomic descriptors are currently limited by their unfavourable scaling with the number of chemical elements $S$ e.g. the length of body-ordered descriptors, such as the Smooth Overlap of Atomic Positions (SOAP) power spectrum (3-body)…

Materials Science · Physics 2022-12-07 James P. Darby , James R. Kermode , Gábor Csányi

Approximate message passing (AMP) is an algorithmic framework for solving linear inverse problems from noisy measurements, with exciting applications such as reconstructing images, audio, hyper spectral images, and various other signals,…

Information Theory · Computer Science 2017-02-13 Junan Zhu , Ryan Pilgrim , Dror Baron

We present the Additive Poisson Process (APP), a novel framework that can model the higher-order interaction effects of the intensity functions in stochastic processes using lower dimensional projections. Our model combines the techniques…

Machine Learning · Statistics 2020-06-17 Simon Luo , Feng Zhou , Lamiae Azizi , Mahito Sugiyama

The automated assembly of complex products requires a system that can automatically plan a physically feasible sequence of actions for assembling many parts together. In this paper, we present ASAP, a physics-based planning approach for…

Synthetic aperture sonar (SAS) requires precise time-of-flight measurements of the transmitted/received waveform to produce well-focused imagery. It is not uncommon for errors in these measurements to be present resulting in image…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Isaac D. Gerg , Vishal Monga

Auditory scene analysis (ASA) aims to retrieve information from the acoustic environment, by carrying out three main tasks: sound source location, separation, and classification. These tasks are traditionally executed with a linear data…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-21 Caleb Rascon , Luis Gato-Diaz , Eduardo García-Alarcón

Adaptive Partition-based Methods (APM) are numerical methods to solve two-stage stochastic linear problems (2SLP). The core idea is to iteratively construct an adapted partition of the space of alea in order to aggregate scenarios while…

Optimization and Control · Mathematics 2021-09-13 Maël Forcier , Vincent Leclère

In one calculation, adjoint sensitivity analysis provides the gradient of a quantity of interest with respect to all system's parameters. Conventionally, adjoint solvers need to be implemented by differentiating computational models, which…

Machine Learning · Computer Science 2024-04-19 Defne E. Ozan , Luca Magri

We consider the problem of estimating parameter sensitivities for stochastic models of multiscale reaction networks. These sensitivity values are important for model analysis, and, the methods that currently exist for sensitivity estimation…

Probability · Mathematics 2018-10-02 Ankit Gupta , Mustafa Khammash

Separation of variables (SoV) is an extremely efficient and elegant technique for analysing physical systems but its application to integrable spin chains was limited until recently to the simplest su(2) cases. In this paper we continue…

High Energy Physics - Theory · Physics 2020-09-24 Nikolay Gromov , Fedor Levkovich-Maslyuk , Paul Ryan , Dmytro Volin

The Multidimensional Assignment Problem (MAP or s-AP in the case of s dimensions) is an extension of the well-known assignment problem. The most studied case of MAP is 3-AP, though the problems with larger values of s have also a number of…

Data Structures and Algorithms · Computer Science 2010-03-30 Gregory Gutin , Daniel Karapetyan

Sensitivity analysis is an important tool used in many domains of computational science to either gain insight into the mathematical model and interaction of its parameters or study the uncertainty propagation through the input-output…

Methodology · Statistics 2023-06-02 Juraj Kardos , Wouter Edeling , Diana Suleimenova , Derek Groen , Olaf Schenk

The estimation of modal parameters from a set of noisy measured data is a highly judgmental task, with user expertise playing a significant role in distinguishing between estimated physical and noise modes of a test-piece. Various methods…

Applications · Statistics 2017-09-13 Vahid Yaghoubi , Majid K. Vakilzadeh , Thomas J. S. Abrahamsson

Numerical simulators are widely used to model physical phenomena and global sensitivity analysis (GSA) aims at studying the global impact of the input uncertainties on the simulator output. To perform GSA, statistical tools based on…

Methodology · Statistics 2026-05-29 Anouar Meynaoui , Amandine Marrel , Béatrice Laurent