English
Related papers

Related papers: Inexact iterative numerical linear algebra for neu…

200 papers

Implicit Neural Representations (INRs) have emerged and shown their benefits over discrete representations in recent years. However, fitting an INR to the given observations usually requires optimization with gradient descent from scratch,…

Machine Learning · Computer Science 2022-08-08 Yinbo Chen , Xiaolong Wang

We develop a methodology to learn finitely generated random iterated function systems from time-series of partial observations using delay embeddings. We obtain a minimal model representation for the observed dynamics, using a hidden…

Dynamical Systems · Mathematics 2025-08-20 Emilia Gibson , Jeroen S. W. Lamb

We introduce a nonlinear stochastic model reduction technique for high-dimensional stochastic dynamical systems that have a low-dimensional invariant effective manifold with slow dynamics, and high-dimensional, large fast modes. Given only…

Machine Learning · Statistics 2023-10-25 Felix X. -F. Ye , Sichen Yang , Mauro Maggioni

In this paper, we focus on regression estimation in both the inductive and the transductive case. We assume that we are given a set of features (which can be a base of functions, but not necessarily). We begin by giving a deviation…

Statistics Theory · Mathematics 2015-06-26 Pierre Alquier

In this work we propose an adaptive multilevel version of subset simulation to estimate the probability of rare events for complex physical systems. Given a sequence of nested failure domains of increasing size, the rare event probability…

Numerical Analysis · Mathematics 2023-12-13 Daniel Elfverson , Robert Scheichl , Simon Weissmann , F. Alejandro DiazDelaO

In structured prediction problems where we have indirect supervision of the output, maximum marginal likelihood faces two computational obstacles: non-convexity of the objective and intractability of even a single gradient computation. In…

Machine Learning · Statistics 2016-08-11 Aditi Raghunathan , Roy Frostig , John Duchi , Percy Liang

We propose an iterative estimating equations procedure for analysis of longitudinal data. We show that, under very mild conditions, the probability that the procedure converges at an exponential rate tends to one as the sample size…

Statistics Theory · Mathematics 2007-12-18 Jiming Jiang , Yihui Luan , You-Gan Wang

We study the dynamics of matrix-valued time series with observed network structures by proposing a matrix network autoregression model with row and column networks of the subjects. We incorporate covariate information and a low rank…

Methodology · Statistics 2023-02-07 Xuening Zhu , Feifei Wang , Zeng Li , Yanyuan Ma

This paper presents a probabilistic approach to represent and quantify model-form uncertainties in the reduced-order modeling of complex systems using operator inference techniques. Such uncertainties can arise in the selection of an…

Machine Learning · Statistics 2024-11-08 Jin Yi Yong , Rudy Geelen , Johann Guilleminot

Predictive linear and nonlinear models based on kernel machines or deep neural networks have been used to discover dependencies among time series. This paper proposes an efficient nonlinear modeling approach for multiple time series, with a…

Machine Learning · Computer Science 2023-10-02 Kevin Roy , Luis Miguel Lopez-Ramos , Baltasar Beferull-Lozano

In recent years, deep learning techniques have shown great success in various tasks related to inverse problems, where a target quantity of interest can only be observed through indirect measurements by a forward operator. Common approaches…

Numerical Analysis · Mathematics 2024-03-18 Matthias Beckmann , Nick Heilenkötter

We propose a new optimization framework for aleatoric uncertainty estimation in regression problems. Existing methods can quantify the error in the target estimation, but they tend to underestimate it. To obtain the predictive uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Takumi Kawashima , Qing Yu , Akari Asai , Daiki Ikami , Kiyoharu Aizawa

Koopman analysis provides a general framework from which to analyze a nonlinear dynamical system in terms of a linear operator acting on an infinite-dimensional observable space. This theoretical framework provides a rigorous underpinning…

Dynamical Systems · Mathematics 2022-10-11 Dan Wilson

Implicit Neural representations (INRs) are widely used for scientific data reduction and visualization by modeling the function that maps a spatial location to a data value. Without any prior knowledge about the spatial distribution of…

Graphics · Computer Science 2024-02-22 Haoyu Li , Han-Wei Shen

Learned image reconstruction techniques using deep neural networks have recently gained popularity, and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Chen Zhang , Riccardo Barbano , Bangti Jin

Discovering governing equations of complex network dynamics is a fundamental challenge in contemporary science with rich data, which can uncover the mysterious patterns and mechanisms of the formation and evolution of complex phenomena in…

Artificial Intelligence · Computer Science 2024-11-12 Jiao Hu , Jiaxu Cui , Bo Yang

This article introduces an iterative distributed computing estimator for the multinomial logistic regression model with large choice sets. Compared to the maximum likelihood estimator, the proposed iterative distributed estimator achieves…

Econometrics · Economics 2024-12-03 Yanqin Fan , Yigit Okar , Xuetao Shi

We consider and analyze applying a spectral inverse iteration algorithm and its subspace iteration variant for computing eigenpairs of an elliptic operator with random coefficients. With these iterative algorithms the solution is sought…

Numerical Analysis · Computer Science 2017-06-16 Harri Hakula , Mikael Laaksonen

Dealing with uncertainty is essential for efficient reinforcement learning. There is a growing literature on uncertainty estimation for deep learning from fixed datasets, but many of the most popular approaches are poorly-suited to…

Machine Learning · Statistics 2018-11-16 Ian Osband , John Aslanides , Albin Cassirer

Researchers have demonstrated state-of-the-art performance in sequential decision making problems (e.g., robotics control, sequential prediction) with deep neural network models. One often has access to near-optimal oracles that achieve…

Machine Learning · Computer Science 2017-03-06 Wen Sun , Arun Venkatraman , Geoffrey J. Gordon , Byron Boots , J. Andrew Bagnell