English
Related papers

Related papers: Fast Randomized Subspace System Identification for…

200 papers

Present day computational fluid dynamics simulations generate extremely large amounts of data, sometimes on the order of TB/s. Often, a significant fraction of this data is discarded because current storage systems are unable to keep pace.…

Computational Engineering, Finance, and Science · Computer Science 2021-03-03 Heather Pacella , Alec Dunton , Alireza Doostan , Gianluca Iaccarino

This work develops a fast, memory-efficient, and general algorithm for accelerated/undersampled dynamic MRI by assuming an approximate LR model on the matrix formed by the vectorized images of the sequence. By general, we mean that our…

Image and Video Processing · Electrical Eng. & Systems 2025-02-28 Silpa Babu , Sajan Goud Lingala , Namrata Vaswani

This paper provides an algorithmic framework for obtaining fast distributed algorithms for a highly-dynamic setting, in which *arbitrarily many* edge changes may occur in each round. Our algorithm significantly improves upon prior work in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-13 Keren Censor-Hillel , Neta Dafni , Victor I. Kolobov , Ami Paz , Gregory Schwartzman

Large models and enormous data are essential driving forces of the unprecedented successes achieved by modern algorithms, especially in scientific computing and machine learning. Nevertheless, the growing dimensionality and model…

Machine Learning · Computer Science 2023-10-04 Yijun Dong

Many applications in data science and scientific computing involve large-scale datasets that are expensive to store and compute with, but can be efficiently compressed and stored in an appropriate tensor format. In recent years, randomized…

Numerical Analysis · Mathematics 2019-05-20 Rachel Minster , Arvind K. Saibaba , Misha E. Kilmer

Recently a deterministic method, frequent directions (FD) is proposed to solve the high dimensional low rank approximation problem. It works well in practice, but experiences high computational cost. In this paper, we establish a fast…

Numerical Analysis · Mathematics 2018-10-09 Dan Teng , Delin Chu

A randomized algorithm for computing a compressed representation of a given rank-structured matrix $A \in \mathbb{R}^{N\times N}$ is presented. The algorithm interacts with $A$ only through its action on vectors. Specifically, it draws two…

Numerical Analysis · Mathematics 2024-06-25 James Levitt , Per-Gunnar Martinsson

Learning a dynamical system from input/output data is a fundamental task in the control design pipeline. In the partially observed setting there are two components to identification: parameter estimation to learn the Markov parameters, and…

Optimization and Control · Mathematics 2021-09-08 Han Wang , James Anderson

A novel fast algorithm for finding quasi identifiers in large datasets is presented. Performance measurements on a broad range of datasets demonstrate substantial reductions in run-time relative to the state of the art and the scalability…

Databases · Computer Science 2014-10-17 Kostyantyn Demchuk , Douglas J. Leith

This paper addresses identification of sparse linear and noise-driven continuous-time state-space systems, i.e., the right-hand sides in the dynamical equations depend only on a subset of the states. The key assumption in this study, is…

Systems and Control · Computer Science 2018-04-18 Zuogong Yue , Johan Thunberg , Lennart Ljung , Jorge Goncalves

The purpose of this text is to provide an accessible introduction to a set of recently developed algorithms for factorizing matrices. These new algorithms attain high practical speed by reducing the dimensionality of intermediate…

Numerical Analysis · Mathematics 2019-02-08 Per-Gunnar Martinsson

Quantum Hamiltonian identification is important for characterizing the dynamics of quantum systems, calibrating quantum devices and achieving precise quantum control. In this paper, an effective two-step optimization (TSO) quantum…

Quantum Physics · Physics 2018-06-05 Yuanlong Wang , Daoyi Dong , Bo Qi , Jun Zhang , Ian R. Petersen , Hidehiro Yonezawa

This paper proposes a probabilistic Bayesian formulation for system identification (ID) and estimation of nonseparable Hamiltonian systems using stochastic dynamic models. Nonseparable Hamiltonian systems arise in models from diverse…

Dynamical Systems · Mathematics 2022-09-19 Harsh Sharma , Nicholas Galioto , Alex A. Gorodetsky , Boris Kramer

Implementing machine learning algorithms on Internet of things (IoT) devices has become essential for emerging applications, such as autonomous driving, environment monitoring. But the limitations of computation capability and energy…

Information Theory · Computer Science 2020-05-26 Xiufeng Huang , Sheng Zhou

Extracting latent low-dimensional structure from high-dimensional data is of paramount importance in timely inference tasks encountered with `Big Data' analytics. However, increasingly noisy, heterogeneous, and incomplete datasets as well…

Machine Learning · Statistics 2015-06-19 Morteza Mardani , Gonzalo Mateos , Georgios B. Giannakis

High-dimensional time-series data are becoming increasingly abundant across a wide variety of domains, spanning economics, neuroscience, particle physics, and cosmology. Fitting statistical models to such data, to enable parameter…

This article details the algorithmics in FLSSS, an R package for solving various subset sum problems. The fundamental algorithm engages the problem via combinatorial space compression adaptive to constraints, relaxations and variations that…

Data Structures and Algorithms · Computer Science 2018-11-27 Charlie Wusuo Liu

We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in…

Computational Physics · Physics 2019-09-20 Pantelis R. Vlachas , Wonmin Byeon , Zhong Y. Wan , Themistoklis P. Sapsis , Petros Koumoutsakos

Deep neural networks have achieved great success in many data processing applications. However, the high computational complexity and storage cost makes deep learning hard to be used on resource-constrained devices, and it is not…

Machine Learning · Computer Science 2023-03-27 Xinwei Ou , Zhangxin Chen , Ce Zhu , Yipeng Liu

In this paper, we study the system identification problem for sparse linear time-invariant systems. We propose a sparsity promoting block-regularized estimator to identify the dynamics of the system with only a limited number of input-state…

Systems and Control · Computer Science 2018-08-28 Salar Fattahi , Somayeh Sojoudi