English
Related papers

Related papers: Optimal piecewise linear data compression for solu…

200 papers

We consider the problem of classifying data manifolds where each manifold represents invariances that are parameterized by continuous degrees of freedom. Conventional data augmentation methods rely upon sampling large numbers of training…

Machine Learning · Computer Science 2018-10-01 SueYeon Chung , Uri Cohen , Haim Sompolinsky , Daniel D. Lee

As the discretization error for the solution of a partial differential equation (PDE) decreases, the precision required to store the corresponding coefficients naturally increases. Storing the solution's finite element coefficients…

Numerical Analysis · Mathematics 2025-11-25 Daniel Bauer , Nils Kohl , Stephen F. McCormick , Rasmus Tamstorf

We consider finite element methods of multiscale type to approximate solutions for two-dimensional symmetric elliptic partial differential equations with heterogeneous $L^\infty$ coefficients. The methods are of Galerkin type and follow the…

Numerical Analysis · Mathematics 2025-05-20 Alexandre L. Madureira , Marcus Sarkis

Variational inequalities as an effective tool for solving applied problems, including machine learning tasks, have been attracting more and more attention from researchers in recent years. The use of variational inequalities covers a wide…

Optimization and Control · Mathematics 2024-12-20 Daniil Medyakov , Gleb Molodtsov , Aleksandr Beznosikov

We study a multigrid method for solving large linear systems of equations with tensor product structure. Such systems are obtained from stochastic finite element discretization of stochastic partial differential equations such as the…

Numerical Analysis · Mathematics 2017-04-11 Howard C. Elman , Tengfei Su

We study how to construct compressed datasets that suffice to recover optimal decisions in linear programs with an unknown cost vector $c$ lying in a prior set $\mathcal{C}$. Recent work by Bennouna et al. provides an exact geometric…

Optimization and Control · Mathematics 2026-05-25 Yuhan Ye , Saurabh Amin , Asuman Ozdaglar

We couple the L1 discretization of the Caputo fractional derivative in time with the Galerkin scheme to devise a linear numerical method for the semilinear subdiffusion equation. Two important points that we make are: nonsmooth initial data…

Numerical Analysis · Mathematics 2025-04-21 Łukasz Płociniczak , Kacper Taźbierski

A methodology grounded in model reduction is presented for accelerating the gradient-based solution of a family of linear or nonlinear constrained optimization problems where the constraints include at least one linear Partial Differential…

Numerical Analysis · Mathematics 2020-04-15 Youngsoo Choi , Gabriele Boncoraglio , Spenser Anderson , David Amsallem , Charbel Farhat

In a previous paper it was shown that a machine learning regression problem can be solved within the framework of random function theory, with the optimal kernel analytically derived from symmetry and indifference principles and coinciding…

Machine Learning · Computer Science 2025-12-19 Yuriy N. Bakhvalov

We analyze the convergence of compressive sensing based sampling techniques for the efficient evaluation of functionals of solutions for a class of high-dimensional, affine-parametric, linear operator equations which depend on possibly…

Numerical Analysis · Mathematics 2015-09-22 Holger Rauhut , Christoph Schwab

In this paper, we study the distributed nonconvex optimization problem, which aims to minimize the average value of the local nonconvex cost functions using local information exchange. To reduce the communication overhead, we introduce…

Optimization and Control · Mathematics 2025-02-12 Lei Xu , Xinlei Yi , Guanghui Wen , Yang Shi , Karl H. Johansson , Tao Yang

Data analysis and interpretation often relies on an approximation of an empirical dataset by some analytic functions or models. Actual implementations usually rely on a non-linear multi-dimensional optimization algorithm, typically…

Instrumentation and Methods for Astrophysics · Physics 2025-01-29 Igor Chilingarian , Kirill Grishin

Computing reduced-order models using non-intrusive methods is particularly attractive for systems that are simulated using black-box solvers. However, obtaining accurate data-driven models can be challenging, especially if the underlying…

Mathematical Physics · Physics 2024-01-03 Alberto Padovan , Blaine Vollmer , Daniel J. Bodony

We focus on two central themes in this dissertation. The first one is on decomposing polytopes and polynomials in ways that allow us to perform nonlinear optimization. We start off by explaining important results on decomposing a polytope…

Combinatorics · Mathematics 2016-05-18 Brandon Dutra

Linear models are used in online decision making, such as in machine learning, policy algorithms, and experimentation platforms. Many engineering systems that use linear models achieve computational efficiency through distributed systems…

Machine Learning · Computer Science 2021-03-04 Jeffrey Wong , Eskil Forsell , Randall Lewis , Tobias Mao , Matthew Wardrop

Reduced-order modeling techniques, including balanced truncation and $\mathcal{H}_2$-optimal model reduction, exploit the structure of linear dynamical systems to produce models that accurately capture the dynamics. For nonlinear systems…

Optimization and Control · Mathematics 2022-01-17 Samuel E. Otto , Alberto Padovan , Clarence W. Rowley

This paper is devoted to the numerical analysis of a control constrained distributed optimal control problem subject to a time fractional diffusion equation with non-smooth initial data. The solutions of state and co-state are decomposed…

Numerical Analysis · Mathematics 2020-10-06 Tao Wang , Binjie Li , Xiaoping Xie

The analysis of complex nonlinear systems is often carried out using simpler piecewise linear representations of them. A principled and practical technique is proposed to linearize and evaluate arbitrary continuous nonlinear functions using…

Optimization and Control · Mathematics 2017-11-10 Guillermo Gallego , Daniel Berjón , Narciso García

Coded distributed computation has become common practice for performing gradient descent on large datasets to mitigate stragglers and other faults. This paper proposes a novel algorithm that encodes the partial derivatives themselves and…

Machine Learning · Computer Science 2022-06-22 Pedro Soto , Ilia Ilmer , Haibin Guan , Jun Li

We investigate a clustering problem with data from a mixture of Gaussians that share a common but unknown, and potentially ill-conditioned, covariance matrix. We start by considering Gaussian mixtures with two equally-sized components and…

Machine Learning · Statistics 2021-11-30 Damek Davis , Mateo Díaz , Kaizheng Wang