English
Related papers

Related papers: Adaptive compression of large vectors

200 papers

Linear algebraic operations are ubiquitous in engineering applications, and arise often in a variety of fields including statistical signal processing and machine learning. With contemporary large datasets, to perform linear algebraic…

Numerical Analysis · Mathematics 2025-09-24 Neophytos Charalambides , Arya Mazumdar

This work introduces a novel, fully robust and highly-scalable, $h$-adaptive aggregated unfitted finite element method for large-scale interface elliptic problems. The new method is based on a recent distributed-memory implementation of the…

Numerical Analysis · Mathematics 2021-04-07 Eric Neiva , Santiago Badia

Well-calibrated probabilistic regression models are a crucial learning component in robotics applications as datasets grow rapidly and tasks become more complex. Unfortunately, classical regression models are usually either probabilistic…

Machine Learning · Computer Science 2023-09-12 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

In a distributed information application an encoder compresses an arbitrary vector while a similar reference vector is available to the decoder as side information. For the Hamming-distance similarity measure, and when guaranteed perfect…

Information Theory · Computer Science 2020-09-08 Yuval Cassuto , Jacob Ziv

We consider adaptive approximations of the parameter-to-solution map for elliptic operator equations depending on a large or infinite number of parameters, comparing approximation strategies of different degrees of nonlinearity: sparse…

Numerical Analysis · Mathematics 2017-04-04 Markus Bachmayr , Albert Cohen , Wolfgang Dahmen

Graphs can be used to represent a wide variety of data belonging to different domains. Graphs can capture the relationship among data in an efficient way, and have been widely used. In recent times, with the advent of Big Data, there has…

Data Structures and Algorithms · Computer Science 2018-06-06 Rushabh Jitendrakumar Shah

In this paper we develop a $C^0$-conforming virtual element method (VEM) for a class of second-order quasilinear elliptic PDEs in two dimensions. We present a posteriori error analysis for this problem and derive a residual based error…

Numerical Analysis · Mathematics 2024-09-27 Scott Congreve , Alice Hodson

The neural network-based approach to solving partial differential equations has attracted considerable attention due to its simplicity and flexibility in representing the solution of the partial differential equation. In training a neural…

Machine Learning · Computer Science 2022-01-10 Jihun Han , Yoonsang Lee

Selecting a good column (or row) subset of massive data matrices has found many applications in data analysis and machine learning. We propose a new adaptive sampling algorithm that can be used to improve any relative-error column selection…

Data Structures and Algorithms · Computer Science 2015-10-15 Saurabh Paul , Malik Magdon-Ismail , Petros Drineas

In the recent years, various gradient descent algorithms including the methods of gradient descent, gradient descent with momentum, adaptive gradient (AdaGrad), root-mean-square propagation (RMSProp) and adaptive moment estimation (Adam)…

Machine Learning · Computer Science 2024-09-19 Abel C. H. Chen

We present an a posteriori error analysis for the mixed virtual element method (mixed VEM) applied to second order elliptic equations in divergence form with mixed boundary conditions. The resulting error estimator is of residual-type. It…

Numerical Analysis · Mathematics 2019-04-24 Andrea Cangiani , Mauricio Munar

This manuscript presents an adaptive high order discretization technique for elliptic boundary value problems. The technique is applied to an updated version of the Hierarchical Poincar\'e-Steklov (HPS) method. Roughly speaking, the HPS…

Numerical Analysis · Mathematics 2018-07-03 Peter Geldermans , Adrianna Gillman

We devise a Hybrid High-Order (HHO) method for highly oscillatory elliptic problems that is capable of handling general meshes. The method hinges on discrete unknowns that are polynomials attached to the faces and cells of a coarse mesh;…

Numerical Analysis · Mathematics 2018-06-18 Matteo Cicuttin , Alexandre Ern , Simon Lemaire

We consider the problem of approximating partition functions for Ising models. We make use of recent tools in combinatorial optimization: the Sherali-Adams and Lasserre convex programming hierarchies, in combination with variational methods…

Machine Learning · Computer Science 2016-07-13 Andrej Risteski

We present two new algebraic multilevel hierarchical matrix algorithms to perform fast matrix-vector product (MVP) for $N$-body problems in $d$ dimensions, namely efficient $\mathcal{H}^2_{*}$ (fully nested algorithm, i.e., $\mathcal{H}^2$…

Numerical Analysis · Mathematics 2026-04-13 Ritesh Khan , Sivaram Ambikasaran

As nowadays Machine Learning (ML) techniques are generating huge data collections, the problem of how to efficiently engineer their storage and operations is becoming of paramount importance. In this article we propose a new lossless…

Data Structures and Algorithms · Computer Science 2022-03-31 Paolo Ferragina , Travis Gagie , Dominik Köppl , Giovanni Manzini , Gonzalo Navarro , Manuel Striani , Francesco Tosoni

Scientific computations or measurements may result in huge volumes of data. Often these can be thought of representing a real-valued function on a high-dimensional domain, and can be conceptually arranged in the format of a tensor of high…

Numerical Analysis · Mathematics 2019-09-24 Mike Espig , Wolfgang Hackbusch , Alexander Litvinenko , Hermann G. Matthies , Elmar Zander

Optimizing machine learning algorithms that are used to solve the objective function has been of great interest. Several approaches to optimize common algorithms, such as gradient descent and stochastic gradient descent, were explored. One…

Machine Learning · Computer Science 2022-10-06 Hilal AlQuabeh , Farha AlBreiki , Dilshod Azizov

Coordinate descent methods employ random partial updates of decision variables in order to solve huge-scale convex optimization problems. In this work, we introduce new adaptive rules for the random selection of their updates. By adaptive,…

Machine Learning · Computer Science 2017-03-08 Dmytro Perekrestenko , Volkan Cevher , Martin Jaggi

We design an adaptive unfitted finite element method on the Cartesian mesh with hanging nodes. We derive an hp-reliable and efficient residual type a posteriori error estimate on K-meshes. A key ingredient is a novel hp-domain inverse…

Numerical Analysis · Mathematics 2021-10-12 Zhiming Chen , Ke Li , Xueshuang Xiang