English
Related papers

Related papers: Second-order adjoint sensitivity analysis procedur…

200 papers

Sensitivity analysis plays a crucial role in multiobjective linear programming (MOLP), where understanding the impact of parameter changes on efficient solutions is essential. This work builds upon and extends previous investigations. In…

Optimization and Control · Mathematics 2024-08-06 Mustapha Kaci

Neural Ordinary Differential Equations (NODEs) are a new class of models that transform data continuously through infinite-depth architectures. The continuous nature of NODEs has made them particularly suitable for learning the dynamics of…

Machine Learning · Computer Science 2020-10-22 Alexander Norcliffe , Cristian Bodnar , Ben Day , Nikola Simidjievski , Pietro Liò

In this paper, a two-step strategy for parametric sensitivity analysis for such systems is proposed, exploiting advantages and synergies between two recently proposed sensitivity analysis methodologies for stochastic dynamics. The first…

Molecular Networks · Quantitative Biology 2016-02-17 Georgios Arampatzis , Markos A. Katsoulakis , Yannis Pantazis

We present a new software system PETSc TSAdjoint for first-order and second-order adjoint sensitivity analysis of time-dependent nonlinear differential equations. The derivative calculation in PETSc TSAdjoint is essentially a high-level…

Mathematical Software · Computer Science 2021-10-28 Hong Zhang , Emil M. Constantinescu , Barry F. Smith

This paper describes a forward algorithm and an adjoint algorithm for computing sensitivity derivatives in chaotic dynamical systems, such as the Lorenz attractor. The algorithms compute the derivative of long time averaged "statistical"…

Computational Physics · Physics 2013-10-25 Qiqi Wang

We present adaptive sequential SAA (sample average approximation) algorithms to solve large-scale two-stage stochastic linear programs. The iterative algorithm framework we propose is organized into \emph{outer} and \emph{inner} iterations…

Optimization and Control · Mathematics 2020-12-08 Raghu Pasupathy , Yongjia Song

In this work we derive a second-order approach to bilevel optimization, a type of mathematical programming in which the solution to a parameterized optimization problem (the "lower" problem) is itself to be optimized (in the "upper"…

Optimization and Control · Mathematics 2022-05-06 Robert Dyro , Edward Schmerling , Nikos Arechiga , Marco Pavone

Second-order optimization methods offer notable advantages in training deep neural networks by utilizing curvature information to achieve faster convergence. However, traditional second-order techniques are computationally prohibitive,…

Machine Learning · Computer Science 2024-10-04 James Vo

Recent work on approximate linear programming (ALP) techniques for first-order Markov Decision Processes (FOMDPs) represents the value function linearly w.r.t. a set of first-order basis functions and uses linear programming techniques to…

Artificial Intelligence · Computer Science 2012-07-02 Scott Sanner , Craig Boutilier

The challenging deployment of compute-intensive applications from domains such as Artificial Intelligence (AI) and Digital Signal Processing (DSP), forces the community of computing systems to explore new design approaches. Approximate…

This contribution deals with identification of fractional-order dynamical systems. System identification, which refers to estimation of process parameters, is a necessity in control theory. Real processes are usually of fractional order as…

Other Computer Science · Computer Science 2016-11-15 Deepyaman Maiti , Mithun Chakraborty , Amit Konar

Extracting from trajectory data meaningful information to understand complex molecular systems might be non-trivial. High-dimensional analyses are typically assumed to be desirable, if not required, to prevent losing important information.…

Chemical Physics · Physics 2025-12-01 Chiara Lionello , Matteo Becchi , Simone Martino , Giovanni M. Pavan

Background: We describe an informatics framework for researchers and clinical investigators to efficiently perform parameter sensitivity analysis and auto-tuning for algorithms that segment and classify image features in a large dataset of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-13 George Teodoro , Tahsin Kurc , Luis F. R. Taveira , Alba C. M. A. Melo , Jun Kong , Joel Saltz

We explore different ways to simplify the evaluation of the smooth overlap of atomic positions (SOAP) many-body atomic descriptor [Bart\'{o}k et al., Phys. Rev. B 87, 184115 (2013)]. Our aim is to improve the computational efficiency of…

Computational Physics · Physics 2019-09-16 Miguel A. Caro

Emerging workloads, such as graph processing and machine learning are approximate because of the scale of data involved and the stochastic nature of the underlying algorithms. These algorithms are often distributed over multiple machines…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-28 Asim Kadav , Erik Kruus

Analog signal processing (ASP) is presented as a systematic approach to address future challenges in high speed and high frequency microwave applications. The general concept of ASP is explained with the help of examples emphasizing basic…

Optics · Physics 2013-08-06 Christophe Caloz , Shulabh Gupta , Qingfeng Zhang , Babak Nikfal

Pairwise comparison data arise in many domains with subjective assessment experiments, for example in image and video quality assessment. In these experiments observers are asked to express a preference between two conditions. However, many…

Machine Learning · Computer Science 2020-04-14 Aliaksei Mikhailiuk , Clifford Wilmot , Maria Perez-Ortiz , Dingcheng Yue , Rafal Mantiuk

We consider time series data modeled by ordinary differential equations (ODEs), widespread models in physics, chemistry, biology and science in general. The sensitivity analysis of such dynamical systems usually requires calculation of…

Methodology · Statistics 2017-09-20 Valdemar Melicher , Tom Haber , Wim Vanroose

Real-world phenomena that can be formulated as signals are often affected by a number of factors and appear as multi-component modes. To understand and process such phenomena, "divide-and-conquer" is probably the most common strategy to…

Signal Processing · Electrical Eng. & Systems 2022-05-30 Lin Li , Charles K. Chui , Qingtang Jiang

We consider estimation of the parameters of a Gaussian Stochastic Process (GaSP), in the context of emulation (approximation) of computer models for which the outcomes are real-valued scalars. The main focus is on estimation of the GaSP…

Statistics Theory · Mathematics 2017-08-17 Mengyang Gu , Xiaojing Wang , James O. Berger