English
Related papers

Related papers: Auto-tuning unit norm frames

200 papers

We present a novel approach that integrates unfitted finite element methods and neural networks to approximate partial differential equations on complex geometries. Easy-to-generate background meshes (e.g., a simple Cartesian mesh) that cut…

Numerical Analysis · Mathematics 2025-12-04 Wei Li , Alberto F. Martín , Santiago Badia

The crucial step in designing a particle filter for a particular application is the choice of importance density. The optimal scheme is to use the conditional posterior density of the state, but this cannot be sampled or calculated…

Computation · Statistics 2014-08-15 Pete Bunch , Simon Godsill

We consider strongly-convex-strongly-concave saddle-point problems with general non-bilinear objective and different condition numbers with respect to the primal and the dual variables. First, we consider such problems with smooth composite…

Optimization and Control · Mathematics 2021-06-15 Vladislav Tominin , Yaroslav Tominin , Ekaterina Borodich , Dmitry Kovalev , Alexander Gasnikov , Pavel Dvurechensky

In this paper, a piecewise quadratic nonconforming finite element method on rectangular grids for a fourth-order elliptic singular perturbation problem is presented. This proposed method is robustly convergent with respect to the…

Numerical Analysis · Mathematics 2020-06-30 Huilan Zeng , Chen-Song Zhang , Shuo Zhang

We consider the problem of sparse atomic optimization, where the notion of "sparsity" is generalized to meaning some linear combination of few atoms. The definition of atomic set is very broad; popular examples include the standard basis,…

Optimization and Control · Mathematics 2019-12-30 Thomas Zhang

The present paper provides a comprehensive study of de-noising properties of frames and, in particular, tight frames, which constitute one of the most popular tools in contemporary signal processing. The objective of the paper is to bridge…

Methodology · Statistics 2013-01-18 Daniela De Canditiis , Marianna Pensky , Patrick J. Wolfe

This article gives a procedure to convert a frame which is not a tight frame into a Parseval frame for the same space, with the requirement that each element in the resulting Parseval frame can be explicitly written as a linear combination…

Functional Analysis · Mathematics 2013-08-26 Enrico Au-Yeung , Somantika Datta

Scalable frames are frames with the property that the frame vectors can be rescaled resulting in tight frames. However, if a frame is not scalable, one has to aim for an approximate procedure. For this, in this paper we introduce three…

Functional Analysis · Mathematics 2014-06-10 Xuemei Chen , Gitta Kutyniok , Kasso A. Okoudjou , Friedrich Philipp , Rongrong Wang

We study the convergence rate of the proximal-gradient homotopy algorithm applied to norm-regularized linear least squares problems, for a general class of norms. The homotopy algorithm reduces the regularization parameter in a series of…

Optimization and Control · Mathematics 2016-09-28 Reza Eghbali , Maryam Fazel

We study the incremental knapsack problem, where one wishes to sequentially pack items into a knapsack whose capacity expands over a finite planning horizon, with the objective of maximizing time-averaged profits. While various…

Data Structures and Algorithms · Computer Science 2020-10-16 Ali Aouad , Danny Segev

Our work presents a new iterative scheme to approximate the fixed points of nonexpansive mapping. The proposed algorithm is constructed to enhance convergence efficiency while preserving theoretical robustness. Under appropriate assumptions…

Functional Analysis · Mathematics 2026-01-12 Nida Izhar Mallick , Izhar Uddin

Spline wavelet tight frames of Ron-Shen have been used widely in frame based image analysis and restorations. However, except for the tight frame property and the approximation order of the truncated series, there are few other properties…

Functional Analysis · Mathematics 2012-01-13 Zuowei Shen , Zhiqiang Xu

Unitary neural networks are promising alternatives for solving the exploding and vanishing activation/gradient problem without the need for explicit normalization that reduces the inference speed. However, they often require longer training…

Machine Learning · Computer Science 2021-02-22 Hao-Yuan Chang

Quasi-Newton methods are well known techniques for large-scale numerical optimization. They use an approximation of the Hessian in optimization problems or the Jacobian in system of nonlinear equations. In the Interior Point context,…

Optimization and Control · Mathematics 2022-09-13 Jacek Gondzio , Francisco N. C. Sobral

This paper is about a curious phenomenon. Suppose we have a data matrix, which is the superposition of a low-rank component and a sparse component. Can we recover each component individually? We prove that under some suitable assumptions,…

Information Theory · Computer Science 2009-12-21 Emmanuel J. Candes , Xiaodong Li , Yi Ma , John Wright

We consider a class of adaptive multilevel domain decomposition-like algorithms, built from a combination of adaptive multilevel finite element, domain decomposition, and partition of unity methods. These algorithms have several interesting…

Numerical Analysis · Mathematics 2010-01-12 Michael Holst

Gradient-based algorithms are one of the methods of choice for the optimisation of Markov Decision Processes. In this article we will present a novel approximate Newton algorithm for the optimisation of such models. The algorithm has…

Optimization and Control · Mathematics 2015-08-05 Thomas Furmston , David Barber

Recovering high-resolution images from limited sensory data typically leads to a serious ill-posed inverse problem, demanding inversion algorithms that effectively capture the prior information. Learning a good inverse mapping from training…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Morteza Mardani , Qingyun Sun , Shreyas Vasawanala , Vardan Papyan , Hatef Monajemi , John Pauly , David Donoho

At its core, machine learning seeks to train models that reliably generalize beyond noisy observations; however, the theoretical vacuum in which state-of-the-art universal approximation theorems (UATs) operate isolates them from this goal,…

Machine Learning · Statistics 2025-09-03 Anastasis Kratsios , Tin Sum Cheng , Daniel Roy

Iterative first-order methods such as gradient descent and its variants are widely used for solving optimization and machine learning problems. There has been recent interest in analytic or numerically efficient methods for computing…

Systems and Control · Computer Science 2020-03-24 Laurent Lessard , Peter Seiler