English
Related papers

Related papers: A parallel rank-adaptive integrator for dynamical …

200 papers

We develop time integration methods in low-rank representation that can adaptively adjust approximation ranks to achieve a prescribed accuracy, while ensuring that these ranks remain proportional to the corresponding best approximation…

Numerical Analysis · Mathematics 2025-07-22 Markus Bachmayr , Matthieu Dolbeault , Polina Sachsenmaier

We propose a parallel adaptive constraint-tightening approach to solve a linear model predictive control problem for discrete-time systems, based on inexact numerical optimization algorithms and operator splitting methods. The underlying…

Optimization and Control · Mathematics 2015-03-24 Laura Ferranti , Tamas Keviczky

In this paper, we develop a novel reduced-rank space-time adaptive processing (STAP) algorithm based on adaptive basis function approximation (ABFA) for airborne radar applications. The proposed algorithm employs the well-known framework of…

Information Theory · Computer Science 2013-03-22 R. Fa , R. C. de Lamare

Training of Generative Adversarial Networks (GANs) is notoriously fragile, requiring to maintain a careful balance between the generator and the discriminator in order to perform well. To mitigate this issue we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Dan Zhang , Anna Khoreva

In many applications of practical interest, solutions of partial differential equation models arise as critical points of an underlying (energy) functional. If such solutions are saddle points, rather than being maxima or minima, then the…

Numerical Analysis · Mathematics 2020-09-07 Pascal Heid , Thomas P. Wihler

We propose a high order adaptive-rank implicit integrators for stiff time-dependent PDEs, leveraging extended Krylov subspaces to efficiently and adaptively populate low-rank solution bases. This allows for the accurate representation of…

Numerical Analysis · Mathematics 2024-04-05 Hamad El Kahza , William Taitano , Jing-Mei Qiu , Luis Chacón

A wide variety of different (fixed-point) iterative methods for the solution of nonlinear equations exists. In this work we will revisit a unified iteration scheme in Hilbert spaces from our previous work that covers some prominent…

Numerical Analysis · Mathematics 2019-05-17 Pascal Heid , Thomas P. Wihler

Imposing an effective structural assumption on neural network weight matrices has been the major paradigm for designing Parameter-Efficient Fine-Tuning (PEFT) systems for adapting modern large pre-trained models to various downstream tasks.…

Machine Learning · Computer Science 2025-02-20 Xin Li , Anand Sarwate

The low-rank approximation is a complexity reduction technique to approximate a tensor or a matrix with a reduced rank, which has been applied to the simulation of high dimensional problems to reduce the memory required and computational…

Computational Physics · Physics 2020-08-26 Zhuogang Peng , Ryan McClarren , Martin Frank

The subject of this work is an adaptive stochastic Galerkin finite element method for parametric or random elliptic partial differential equations, which generates sparse product polynomial expansions with respect to the parametric…

Numerical Analysis · Mathematics 2025-03-28 Markus Bachmayr , Martin Eigel , Henrik Eisenmann , Igor Voulis

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

Adaptive nuclear-norm penalization is proposed for low-rank matrix approximation, by which we develop a new reduced-rank estimation method for the general high-dimensional multivariate regression problems. The adaptive nuclear norm of a…

Methodology · Statistics 2012-09-25 Kun Chen , Hongbo Dong , Kung-Sik Chan

In this paper, we consider the dual formulation of minimizing $\sum_{i\in I}f_i(x_i)+\sum_{j\in J} g_j(\mathcal{A}_jx)$ with the index sets $I$ and $J$ being large. To address the difficulties from the high dimension of the variable $x$…

Optimization and Control · Mathematics 2020-09-03 Hui Zhang , Yu-Hong Dai , Lei Guo

In algorithms for solving optimization problems constrained to a smooth manifold, retractions are a well-established tool to ensure that the iterates stay on the manifold. More recently, it has been demonstrated that retractions are a…

Numerical Analysis · Mathematics 2024-03-11 Axel Séguin , Gianluca Ceruti , Daniel Kressner

Low-rank matrix estimation is a canonical problem that finds numerous applications in signal processing, machine learning and imaging science. A popular approach in practice is to factorize the matrix into two compact low-rank factors, and…

Machine Learning · Computer Science 2021-06-16 Tian Tong , Cong Ma , Yuejie Chi

Low-rank matrix completion consists of computing a matrix of minimal complexity that recovers a given set of observations as accurately as possible. Unfortunately, existing methods for matrix completion are heuristics that, while highly…

Machine Learning · Computer Science 2026-03-12 Dimitris Bertsimas , Ryan Cory-Wright , Sean Lo , Jean Pauphilet

This paper is concerned with the construction, analysis and realization of a numerical method to approximate the solution of high dimensional elliptic partial differential equations. We propose a new combination of an Adaptive Wavelet…

Numerical Analysis · Mathematics 2018-05-31 Mazen Ali , Karsten Urban

In this paper, in order to improve the spatial accuracy, the exponential integrator Fourier Galerkin method (EIFG) is proposed for solving semilinear parabolic equations in rectangular domains. In this proposed method, the spatial…

Numerical Analysis · Mathematics 2024-12-02 Jianguo Huang , Yuejin Xu

The explicit low-rank regularization, e.g., nuclear norm regularization, has been widely used in imaging sciences. However, it has been found that implicit regularization outperforms explicit ones in various image processing tasks. Another…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Zhemin Li , Tao Sun , Hongxia Wang , Bao Wang

In this paper, we propose an efficient parallelization strategy for boundary element method (BEM) solvers that perform the electromagnetic analysis of structures with lossy conductors. The proposed solver is accelerated with the adaptive…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-30 Damian Marek , Shashwat Sharma , Piero Triverio