English
Related papers

Related papers: Online randomized interpolative decomposition with…

200 papers

A key characteristic of deep recommendation models is the immense memory requirements of their embedding tables. These embedding tables can often reach hundreds of gigabytes which increases hardware requirements and training cost. A common…

A novel algorithm for the recovery of low-rank matrices acquired via compressive linear measurements is proposed and analyzed. The algorithm, a variation on the iterative hard thresholding algorithm for low-rank recovery, is designed to…

Numerical Analysis · Mathematics 2018-10-30 Simon Foucart , Srinivas Subramanian

Due to the highly non-convex nature of large-scale robust parameter estimation, avoiding poor local minima is challenging in real-world applications where input data is contaminated by a large or unknown fraction of outliers. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Huu Le , Christopher Zach

A novel procedure for the online identification of a class of discrete-time switched linear systems, which simultaneously estimates the parameters and switching manifolds of the systems, is proposed in this paper. Firstly, to estimate the…

Systems and Control · Electrical Eng. & Systems 2023-03-08 Zengjie Zhang , Yingwei Du , Tong Liu , Fangzhou Liu , Martin Buss

In this study we propose a-posteriori error estimation results to approximate the precision loss in quantities of interests computed using reduced order models. To generate the surrogate models we employ Proper Orthogonal Decomposition and…

Numerical Analysis · Mathematics 2024-12-20 R. Stefanescu , A. Sandu

We introduce a recursive algorithm for performing compressed sensing on streaming data. The approach consists of a) recursive encoding, where we sample the input stream via overlapping windowing and make use of the previous measurement in…

Machine Learning · Statistics 2013-12-18 Nikolaos M. Freris , Orhan Öçal , Martin Vetterli

Efficient and fast computation of a tensor singular value decomposition (t-SVD) with a few passes over the underlying data tensor is crucial because of its many potential applications. The current/existing subspace randomized algorithms…

Numerical Analysis · Mathematics 2025-02-10 Salman Ahmadi-Asl , Anh-Huy Phan , Andrzej Cichocki

We present herein a scheme by which to accurately evaluate the error exponents of a lossy data compression problem, which characterize average probabilities over a code ensemble of compression failure and success above or below a critical…

Statistical Mechanics · Physics 2007-05-23 Tadaaki Hosaka , Yoshiyuki Kabashima

Low-rank matrix approximations play a fundamental role in numerical linear algebra and signal processing applications. This paper introduces a novel rank-revealing matrix decomposition algorithm termed Compressed Randomized UTV (CoR-UTV)…

Numerical Analysis · Computer Science 2018-10-18 M. Kaloorazi , R. C. de Lamare

We consider some iterative methods for finding the best interpolation data in the images compression with noise. The interpolation data consists of the set of pixels and their grey/color values. The aim in the iterative approach is to allow…

Analysis of PDEs · Mathematics 2022-09-30 Zakaria Belhachmi , Thomas Jacumin

We present a progressive image decomposition method based on a novel non-linear filter named Sub-window Variance filter. Our method is specifically designed for image detail enhancement purpose; this application requires extraction of image…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Kin-Ming Wong

Online sparse linear regression is an online problem where an algorithm repeatedly chooses a subset of coordinates to observe in an adversarially chosen feature vector, makes a real-valued prediction, receives the true label, and incurs the…

Machine Learning · Computer Science 2020-07-27 Satyen Kale , Zohar Karnin , Tengyuan Liang , Dávid Pál

Implementing machine learning algorithms on Internet of things (IoT) devices has become essential for emerging applications, such as autonomous driving, environment monitoring. But the limitations of computation capability and energy…

Information Theory · Computer Science 2020-05-26 Xiufeng Huang , Sheng Zhou

Matrix decomposition is a very important mathematical tool in numerical linear algebra for data processing. In this paper, we introduce a new randomized matrix decomposition algorithm, which is called randomized approximate SVD based on…

Numerical Analysis · Mathematics 2023-05-22 Xiaohui Ni , An-Bao Xu

Learning-based lossy image compression usually involves the joint optimization of rate-distortion performance. Most existing methods adopt spatially invariant bit length allocation and incorporate discrete entropy approximation to constrain…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Mu Li , Wangmeng Zuo , Shuhang Gu , Jane You , David Zhang

A novel refinement measure for non-intrusive surrogate modelling of partial differential equations (PDEs) with uncertain parameters is proposed. Our approach uses an empirical interpolation procedure, where the proposed refinement measure…

Numerical Analysis · Mathematics 2019-07-10 Yous van Halder , Benjamin Sanderse , Barry Koren

It has been witnessed that learned image compression has outperformed conventional image coding techniques and tends to be practical in industrial applications. One of the most critical issues that need to be considered is the…

Image and Video Processing · Electrical Eng. & Systems 2022-12-01 Dailan He , Ziming Yang , Yuan Chen , Qi Zhang , Hongwei Qin , Yan Wang

Data management is becoming increasingly important in dealing with the large amounts of data produced by large-scale scientific simulations and instruments. Existing multilevel compression algorithms offer a promising way to manage…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-12 Xin Liang , Ben Whitney , Jieyang Chen , Lipeng Wan , Qing Liu , Dingwen Tao , James Kress , Dave Pugmire , Matthew Wolf , Norbert Podhorszki , Scott Klasky

This paper introduces a new framework for constructing the Discrete Empirical Interpolation Method DEIM projection operator. The interpolation node selection procedure is formulated using the QR factorization with column pivoting, and it…

Numerical Analysis · Computer Science 2016-09-26 Zlatko Drmac , Serkan Gugercin

Linear least-squares regression with a "design" matrix A approximates a given matrix B via minimization of the spectral- or Frobenius-norm discrepancy ||AX-B|| over every conformingly sized matrix X. Another popular approximation is…

Methodology · Statistics 2024-04-09 Mark Tygert