English
Related papers

Related papers: Fast Algorithm for Relaxation Processes in Big-dat…

200 papers

In this article, a novel fast randomized subspace system identification method for estimating combined deterministic-stochastic LTI state-space models, is proposed. The algorithm is especially well-suited to identify high-order and…

Systems and Control · Electrical Eng. & Systems 2023-12-12 Vatsal Kedia , Debraj Chakraborty

Sparsity-based methods are widely used in machine learning, statistics, and signal processing. There is now a rich class of structured sparsity approaches that expand the modeling power of the sparsity paradigm and incorporate constraints…

Data Structures and Algorithms · Computer Science 2017-12-22 Aleksander Mądry , Slobodan Mitrović , Ludwig Schmidt

Inhomogeneous dynamical mean-field theory has been employed to solve many interesting strongly interacting problems from transport in multilayered devices to the properties of ultracold atoms in a trap. The main computational step,…

Strongly Correlated Electrons · Physics 2011-02-17 Pierre Carrier , Jok M. Tang , Yousef Saad , James K. Freericks

We consider the problem of computing optimal policies in average-reward Markov decision processes. This classical problem can be formulated as a linear program directly amenable to saddle-point optimization methods, albeit with a number of…

Optimization and Control · Mathematics 2020-01-13 Joan Bas-Serrano , Gergely Neu

Many neural learning algorithms require to solve large least square systems in order to obtain synaptic weights. Moore-Penrose inverse matrices allow for solving such systems, even with rank deficiency, and they provide minimum-norm vectors…

Neural and Evolutionary Computing · Computer Science 2008-12-18 Pierre Courrieu

In this article, we design fast algorithms for the computation of approximant bases in shifted Popov normal form. We first recall the algorithm known as PM-Basis, which will be our second fundamental engine after polynomial matrix…

Symbolic Computation · Computer Science 2019-04-09 Claude-Pierre Jeannerod , Vincent Neiger , Gilles Villard

We propose a new method for low-rank approximation of Moore-Penrose pseudoinverses (MPPs) of large-scale matrices using tensor networks. The computed pseudoinverses can be useful for solving or preconditioning of large-scale overdetermined…

Numerical Analysis · Mathematics 2016-07-06 Namgil Lee , Andrzej Cichocki

This paper introduces a new Monte Carlo algorithm to invert large matrices. It is based on simultaneous coupled draws from two random vectors whose covariance is the required inverse. It can be considered a generalization of a previously…

Data Structures and Algorithms · Computer Science 2025-10-20 L. A. Garcia-Cortes , C. Cabrillo

Gaussian processes are a powerful framework for uncertainty-aware function approximation and sequential decision-making. Unfortunately, their classical formulation does not scale gracefully to large amounts of data and modern hardware for…

Machine Learning · Computer Science 2025-07-10 Jihao Andreas Lin

The affine inverse eigenvalue problem consists of identifying a real symmetric matrix with a prescribed set of eigenvalues in an affine space. Due to its ubiquity in applications, various instances of the problem have been widely studied in…

Optimization and Control · Mathematics 2019-11-07 Utkan Candogan , Yong Sheng Soh , Venkat Chandrasekaran

Logistic Gaussian process (LGP) priors provide a flexible alternative for modelling unknown densities. The smoothness properties of the density estimates can be controlled through the prior covariance structure of the LGP, but the challenge…

Computation · Statistics 2016-11-01 Jaakko Riihimäki , Aki Vehtari

How can we compute the pseudoinverse of a sparse feature matrix efficiently and accurately for solving optimization problems? A pseudoinverse is a generalization of a matrix inverse, which has been extensively utilized as a fundamental…

Machine Learning · Computer Science 2020-11-10 Jinhong Jung , Lee Sael

In this paper, we propose an adaptive fast solver for a general class of symmetric positive definite (SPD) matrices which include the well-known graph Laplacian. We achieve this by developing an adaptive operator compression scheme and a…

Numerical Analysis · Mathematics 2018-03-06 Thomas Y. Hou , D. Huang , K. C. Lam , P. Zhang

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Computer Science 2014-08-12 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Statistics 2013-05-27 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet

We demonstrate an efficient algorithm for inverse problems in time-dependent quantum dynamics based on feedback loops between Hamiltonian parameters and the solutions of the Schr\"{o}dinger equation. Our approach formulates the inverse…

Computational Physics · Physics 2020-10-27 Z. Deng , I. Tutunnikov , I. Sh. Averbukh , M. Thachuk , R. V. Krems

Reaching consensus among states of a multi-agent system is a key requirement for many distributed control/optimization problems. Such a consensus is often achieved using the standard Laplacian matrix (for continuous system) or Perron matrix…

Systems and Control · Computer Science 2017-07-25 Zheming Wang , Chong Jin Ong

The parallel linear equations solver capable of effectively using 1000+ processors becomes the bottleneck of large-scale implicit engineering simulations. In this paper, we present a new hierarchical parallel master-slave-structural…

Computational Physics · Physics 2015-06-11 Ran Xu , Bin Liu , Yuan Dong

We consider the problem of estimating sparse graphs by a lasso penalty applied to the inverse covariance matrix. Using a coordinate descent procedure for the lasso, we develop a simple algorithm that is remarkably fast: in the worst cases,…

Methodology · Statistics 2007-08-28 Jerome Friedman , Trevor Hastie , Robert Tibshirani

A recently discovered universal rank-based matrix method to extract trends from noisy time series is described in [1] but the formula for the output matrix elements, implemented there as an open-access supplement MATLAB computer code, is…

Data Analysis, Statistics and Probability · Physics 2020-06-24 D. J. Kestner , G. R. Ierley , A. B. Kostinski