English
Related papers

Related papers: Constructive sparse trigonometric approximation fo…

200 papers

Parallel and cyclic projection algorithms are proposed for minimizing the sum of a finite family of convex functions over the intersection of a finite family of closed convex subsets of a Hilbert space. These algorithms are of…

Optimization and Control · Mathematics 2019-01-08 Hong-Kun Xu , Vera Roshchina

We investigate the performance of a deterministic GREEDY algorithm for the problem of maximizing functions under a partition matroid constraint. We consider non-monotone submodular functions and monotone subadditive functions. Even though…

Discrete Mathematics · Computer Science 2019-02-22 Tobias Friedrich , Andreas Göbel , Frank Neumann , Francesco Quinzan , Ralf Rothenberger

In practice, optimization tasks have some structure that allows developing new algorithms for every problem with faster convergence rates. Using the structure of optimization tasks, we can propose algorithms with more optimistic convergence…

Optimization and Control · Mathematics 2020-09-01 Alexander Tyurin

This paper demonstrates that the space of piecewise smooth functions can be well approximated by the space of functions defined by a set of simple (non-linear) operations on smooth uniform splines. The examples include bivariate functions…

Numerical Analysis · Mathematics 2024-05-13 David Levin

Non-negative signals form an important class of sparse signals. Many algorithms have already beenproposed to recover such non-negative representations, where greedy and convex relaxed algorithms are among the most popular methods. The…

Signal Processing · Electrical Eng. & Systems 2020-07-29 Konstantinos A. Voulgaris , Mike E. Davies , Mehrdad Yaghoobi

Sparse polynomial approximation has become indispensable for approximating smooth, high- or infinite-dimensional functions from limited samples. This is a key task in computational science and engineering, e.g., surrogate modelling in…

Numerical Analysis · Mathematics 2023-11-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

The problem of sparse approximation and the closely related compressed sensing have received tremendous attention in the past decade. Primarily studied from the viewpoint of applied harmonic analysis and signal processing, there have been…

Information Theory · Computer Science 2018-10-23 Ali Çivril

This paper focuses on the development of novel greedy techniques for distributed learning under sparsity constraints. Greedy techniques have widely been used in centralized systems due to their low computational requirements and at the same…

Information Theory · Computer Science 2015-06-23 Symeon Chouvardas , Gerasimos Mileounis , Nicholas Kalouptsidis , Sergios Theodoridis

We study the problem of maximizing constrained non-monotone submodular functions and provide approximation algorithms that improve existing algorithms in terms of either the approximation factor or simplicity. Our algorithms combine…

Data Structures and Algorithms · Computer Science 2016-03-01 Salman Fadaei , MohammadAmin Fazli , MohammadAli Safari

In this contribution we are concerned with tight a posteriori error estimation for projection based model order reduction of $\inf$-$\sup$ stable parameterized variational problems. In particular, we consider the Reduced Basis Method in a…

Numerical Analysis · Mathematics 2018-02-12 Stefan Hain , Mario Ohlberger , Mladjan Radic , Karsten Urban

We consider the problem of minimizing a composite convex function with two different access methods: an oracle, for which we can evaluate the value and gradient, and a structured function, which we access only by solving a convex…

Optimization and Control · Mathematics 2021-11-30 Xinyue Shen , Alnur Ali , Stephen Boyd

Tame functions are a class of nonsmooth, nonconvex functions, which feature in a wide range of applications: functions encountered in the training of deep neural networks with all common activations, value functions of mixed-integer…

Optimization and Control · Mathematics 2024-06-05 Gilles Bareilles , Johannes Aspman , Jiri Nemecek , Jakub Marecek

We consider the problem of maximizing a monotone nondecreasing set function under multiple constraints, where the constraints are also characterized by monotone nondecreasing set functions. We propose two greedy algorithms to solve the…

Optimization and Control · Mathematics 2023-05-09 Lintao Ye , Zhi-Wei Liu , Ming Chi , Vijay Gupta

In this paper we give an algorithmic description of Freyd categories that subsumes and enhances the usual approach to finitely presented modules in computer algebra. The upshot is a constructive approach to finitely presented functors that…

Category Theory · Mathematics 2020-10-15 Sebastian Posur

A fast algorithm for the approximation of a low rank LU decomposition is presented. In order to achieve a low complexity, the algorithm uses sparse random projections combined with FFT-based random projections. The asymptotic approximation…

Numerical Analysis · Mathematics 2016-01-19 Yariv Aizenbud , Gil Shabat , Amir Averbuch

In this chapter, we discuss recent work on learning sparse approximations to high-dimensional functions on data, where the target functions may be scalar-, vector- or even Hilbert space-valued. Our main objective is to study how the…

Numerical Analysis · Mathematics 2022-02-08 Ben Adcock , Juan M. Cardenas , Nick Dexter , Sebastian Moraga

Finding efficient tensor contraction paths is essential for a wide range of problems, including model counting, quantum circuits, graph problems, and language models. There exist several approaches to find efficient paths, such as the…

Quantum Physics · Physics 2024-05-17 Sheela Orgler , Mark Blacher

With the availability of more powerful computers, iterative reconstruction algorithms are the subject of an ongoing work in the design of more efficient reconstruction algorithms for X-ray computed tomography. In this work, we show how two…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 D. Trinca , Y. Zhong

Sparse representation of a single measurement vector (SMV) has been explored in a variety of compressive sensing applications. Recently, SMV models have been extended to solve multiple measurement vectors (MMV) problems, where the…

Optimization and Control · Mathematics 2020-08-25 Jing Qin , Shuang Li , Deanna Needell , Anna Ma , Rachel Grotheer , Chenxi Huang , Natalie Durgin

The parameters of a neural network are naturally organized in groups, some of which might not contribute to its overall performance. To prune out unimportant groups of parameters, we can include some non-differentiable penalty to the…

Machine Learning · Computer Science 2023-01-06 Tristan Deleu , Yoshua Bengio