English
Related papers

Related papers: Optimal piecewise linear data compression for solu…

200 papers

We present a new method that includes three key components of distributed optimization and federated learning: variance reduction of stochastic gradients, partial participation, and compressed communication. We prove that the new method has…

Machine Learning · Computer Science 2024-01-04 Alexander Tyurin , Peter Richtárik

While approaches to model the progression of fracture have received significant attention, methods to find the solution to the associated nonlinear equations have not. In general, nonlinear solution methods and optimization methods have a…

Numerical Analysis · Mathematics 2025-02-28 Alberto Cattaneo , Varun Shankar , M. Keith Ballard

Clustering functional data is a challenging task due to intrinsic infinite-dimensionality and the need for stable, data-adaptive partitioning. In this work, we propose a clustering framework based on Random Projections, which simultaneously…

Methodology · Statistics 2025-12-18 Matteo Mori , Laura Anderlucci

This article surveys nonlinear model reduction methods that remain effective in regimes where linear reduced-space approximations are intrinsically inefficient, such as transport-dominated problems with wave-like phenomena and moving…

Numerical Analysis · Mathematics 2026-02-03 Jan S. Hesthaven , Benjamin Peherstorfer , Benjamin Unger

We introduce a data-driven order reduction method for nonlinear control systems, drawing on recent progress in machine learning and statistical dimensionality reduction. The method rests on the assumption that the nonlinear system behaves…

Optimization and Control · Mathematics 2016-04-04 Jake Bouvrie , Boumediene Hamzi

We study the problem of deriving compressibility measures for Piecewise Linear Approximations (PLAs), i.e., error-bounded approximations of a set of two-dimensional increasing data points using a sequence of segments. Such approximations…

Data Structures and Algorithms · Computer Science 2025-09-12 Paolo Ferragina , Filippo Lari

This letter presents a new spectral-clustering-based approach to the subspace clustering problem. Underpinning the proposed method is a convex program for optimal direction search, which for each data point d finds an optimal direction in…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Mostafa Rahmani , George Atia

Reduced order models (ROMs) are widely used in scientific computing to tackle high-dimensional systems. However, traditional ROM methods may only partially capture the intrinsic geometric characteristics of the data. These characteristics…

Numerical Analysis · Mathematics 2025-01-13 Moaad Khamlich , Federico Pichi , Gianluigi Rozza

The paper addresses a numerical method for solving second order elliptic partial differential equations that describe fields inside heterogeneous media. The scope is general and treats the case of rough coefficients, i.e. coefficients with…

Numerical Analysis · Mathematics 2010-11-30 Ivo Babuska , Robert Lipton

Image compression has been a frequent topic of presentations at ADASS. Compression is often viewed as just a technique to fit more data into a smaller space. Rather, the packing of data - its "density" - affects every facet of local data…

Instrumentation and Methods for Astrophysics · Physics 2009-10-21 Robert L. Seaman , Richard L. White , William D. Pence

In this paper, we investigate adaptive nonlinear regression and introduce tree based piecewise linear regression algorithms that are highly efficient and provide significantly improved performance with guaranteed upper bounds in an…

Machine Learning · Computer Science 2013-12-30 N. Denizcan Vanli , Suleyman S. Kozat

Dynamical low-rank (DLR) approximation has gained interest in recent years as a viable solution to the curse of dimensionality in the numerical solution of kinetic equations including the Boltzmann and Vlasov equations. These methods…

Numerical Analysis · Mathematics 2024-04-12 Jack Coughlin , Jingwei Hu , Uri Shumlak

Recently, linear regression models incorporating an optimal transport (OT) loss have been explored for applications such as supervised unmixing of spectra, music transcription, and mass spectrometry. However, these task-specific approaches…

Models with dominant advection always posed a difficult challenge for projection-based reduced order modelling. Many methodologies that have recently been proposed are based on the pre-processing of the full-order solutions to accelerate…

Numerical Analysis · Mathematics 2022-03-02 Davide Papapicco , Nicola Demo , Michele Girfoglio , Giovanni Stabile , Gianluigi Rozza

We analyze the clustering problem through a flexible probabilistic model that aims to identify an optimal partition on the sample X 1 , ..., X n. We perform exact clustering with high probability using a convex semidefinite estimator that…

Statistics Theory · Mathematics 2017-05-19 Martin Royer

Solving a large-scale system of linear equations is a key step at the heart of many algorithms in machine learning, scientific computing, and beyond. When the problem dimension is large, computational and/or memory constraints make it…

Machine Learning · Computer Science 2017-12-12 Navid Azizan-Ruhi , Farshad Lahouti , Salman Avestimehr , Babak Hassibi

Clustering and dimensionality reduction have been crucial topics in machine learning and computer vision. Clustering high-dimensional data has been challenging for a long time due to the curse of dimensionality. For that reason, a more…

Machine Learning · Statistics 2026-04-16 Sida Liu , Yangzi Guo , Mingyuan Wang

A data-driven formulation of the optimal transport problem is presented and solved using adaptively refined meshes to decompose the problem into a sequence of finite linear programming problems. Both the marginal distributions and their…

Numerical Analysis · Mathematics 2017-10-11 Weikun Chen , Esteban G. Tabak

Solvers for partial differential equations (PDE) are one of the cornerstones of computational science. For large problems, they involve huge amounts of data that needs to be stored and transmitted on all levels of the memory hierarchy.…

Numerical Analysis · Mathematics 2019-09-19 Sebastian Götschel , Martin Weiser

We present a generative reduced basis (RB) approach to construct reduced order models for parametrized partial differential equations. Central to this approach is the construction of generative RB spaces that provide rapidly convergent…

Numerical Analysis · Mathematics 2024-10-08 Ngoc Cuong Nguyen