English
Related papers

Related papers: Computing Active Subspaces Efficiently with Gradie…

200 papers

Active learning is proposed for selection of the next operating points in the design of experiments, for identifying linear parameter-varying systems. We extend existing approaches found in literature to multiple-input multiple-output…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Robert Chin , Alejandro I. Maass , Nalika Ulapane , Chris Manzie , Iman Shames , Dragan Nešić , Jonathan E. Rowe , Hayato Nakada

Active inference has emerged as an alternative approach to control problems given its intuitive (probabilistic) formalism. However, despite its theoretical utility, computational implementations have largely been restricted to…

Machine Learning · Computer Science 2022-03-01 Aswin Paul , Noor Sajid , Manoj Gopalkrishnan , Adeel Razi

Subsampling layers play a crucial role in deep nets by discarding a portion of an activation map to reduce its spatial dimensions. This encourages the deep net to learn higher-level representations. Contrary to this motivation, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Chiao-An Yang , Ziwei Liu , Raymond A. Yeh

Computer experiments refer to the study of real systems using complex simulation models. They have been widely used as alternatives to physical experiments. Design and analysis of computer experiments have attracted great attention in past…

Methodology · Statistics 2025-04-29 Anita Shahrokhian , Xinwei Deng , C. Devon Lin

Memory footprint is one of the main limiting factors for large neural network training. In backpropagation, one needs to store the input to each operation in the computational graph. Every modern neural network model has quite a few…

Machine Learning · Computer Science 2022-02-04 Georgii Novikov , Daniel Bershatsky , Julia Gusak , Alex Shonenkov , Denis Dimitrov , Ivan Oseledets

It is often possible to perform reduced order modelling by specifying linear subspace which accurately captures the dynamics of the system. This approach becomes especially appealing when linear subspace explicitly depends on parameters of…

Machine Learning · Computer Science 2026-04-17 Vladimir Fanaskov , Vladislav Trifonov , Alexander Rudikov , Ekaterina Muravleva , Ivan Oseledets

Pseudospectra and structured pseudospectra are important tools for the analysis of matrices. Their computation, however, can be very demanding for all but small matrices. A new approach to compute approximations of pseudospectra and…

Numerical Analysis · Mathematics 2016-11-16 Silvia Noschese , Lothar Reichel

An emulator is a fast-to-evaluate statistical approximation of a detailed mathematical model (simulator). When used in lieu of simulators, emulators can expedite tasks that require many repeated evaluations, such as sensitivity analyses,…

Active learning in computer experiments aims at allocating resources in an intelligent manner based on the already observed data to satisfy certain objectives such as emulating or optimizing a computationally expensive function. There are…

Methodology · Statistics 2025-01-24 Difan Song , V. Roshan Joseph

We study active perception from first principles to argue that an autonomous agent performing active perception should maximize the mutual information that past observations posses about future ones. Doing so requires (a) a representation…

Robotics · Computer Science 2024-05-07 Siming He , Christopher D. Hsu , Dexter Ong , Yifei Simon Shao , Pratik Chaudhari

Neural network training relies on gradient computation through backpropagation, yet memory requirements for storing layer activations present significant scalability challenges. We present the first adaptation of control-theoretic matrix…

Machine Learning · Computer Science 2025-10-02 Harbir Antil , Deepanshu Verma

We present a novel class of methods to compute functions of matrices or their action on vectors that are suitable for parallel programming. Solving appropriate simple linear systems of equations in parallel (or computing the inverse of…

Numerical Analysis · Mathematics 2022-10-10 Sergio Blanes

We propose a snapshots-based method to compute reduction subspaces for physics-based simulations. Our method is applicable to any mesh with some artistic prior knowledge of the solution and only requires a record of existing solutions…

Dynamical Systems · Mathematics 2025-02-12 Shaimaa Monem , Peter Benner , Christian Lessig

The Markov chain Monte Carlo (MCMC) method is the computational workhorse for Bayesian inverse problems. However, MCMC struggles in high-dimensional parameter spaces, since its iterates must sequentially explore the high-dimensional space.…

Numerical Analysis · Mathematics 2016-09-06 Paul G. Constantine , Carson Kent , Tan Bui-Thanh

Sketched gradient algorithms have been recently introduced for efficiently solving the large-scale constrained Least-squares regressions. In this paper we provide novel convergence analysis for the basic method {\it Gradient Projection…

Optimization and Control · Mathematics 2017-06-05 Junqi Tang , Mohammad Golbabaee , Mike Davies

Large-scale eigenvalue problems arise in various fields of science and engineering and demand computationally efficient solutions. In this study, we investigate the subspace approximation for parametric linear eigenvalue problems, aiming to…

Quantifying uncertainties in physical or engineering systems often requires a large number of simulations of the underlying computer models that are computationally intensive. Emulators or surrogate models are often used to accelerate the…

Methodology · Statistics 2021-11-11 Junda Xiong , Xin Cai , Jinglai Li

Simulation models often have parameters as input and return outputs to understand the behavior of complex systems. Calibration is the process of estimating the values of the parameters in a simulation model in light of observed data from…

Methodology · Statistics 2024-11-15 Özge Sürer

Many collective systems exist in nature far from equilibrium, ranging from cellular sheets up to flocks of birds. These systems reflect a form of active matter, whereby individual material components have internal energy. Under specific…

Soft Condensed Matter · Physics 2023-04-17 Namid R. Stillman , Silke Henkes , Roberto Mayor , Gilles Louppe

Consider scene understanding problems such as predicting where a person is probably reaching, or inferring the pose of 3D objects from depth images, or inferring the probable street crossings of pedestrians at a busy intersection. This…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Javier Felip , Nilesh Ahuja , David Gómez-Gutiérrez , Omesh Tickoo , Vikash Mansinghka