English
Related papers

Related papers: Numerical stability of the symplectic $LL^T$ facto…

200 papers

In this paper, we consider a class of non-convex and non-smooth sparse optimization problems, which encompass most existing nonconvex sparsity-inducing terms. We show the second-order optimality conditions only depend on the nonzeros of the…

Optimization and Control · Mathematics 2024-12-13 Luwei Bai , Yaohua Hu , Hao Wang , Xiaoqi Yang

This article introduces new multiplicative updates for nonnegative matrix factorization with the $\beta$-divergence and sparse regularization of one of the two factors (say, the activation matrix). It is well known that the norm of the…

Machine Learning · Computer Science 2024-03-13 Arthur Marmin , José Henrique de Morais Goulart , Cédric Févotte

Symmetric Nonnegative Matrix Factorization (SymNMF) is a technique in data analysis and machine learning that approximates a symmetric matrix with a product of a nonnegative, low-rank matrix and its transpose. To design faster and more…

Machine Learning · Computer Science 2024-12-02 Koby Hayashi , Sinan G. Aksoy , Grey Ballard , Haesun Park

In this paper, we consider a regularization strategy for the factorization method when there is noise added to the data operator. The factorization method is a qualitative method used in shape reconstruction problems. These methods are…

Analysis of PDEs · Mathematics 2023-04-05 Isaac Harris

Let $A = \begin{bmatrix} E & F \\ F^T & G \end{bmatrix}$ be a $2n \times 2n$ real positive definite matrix, where $E, F,$ and $G$ are $n \times n$ blocks. It is shown that $\ d(E \oplus G) \prec^w d(A)$. Here $d(A)$ denotes the $n$-vector…

Functional Analysis · Mathematics 2026-03-31 Temjensangba , Hemant Kumar Mishra

Consider a complete communication network of $n$ nodes, where the nodes receive a common clock pulse. We study the synchronous $c$-counting problem: given any starting state and up to $f$ faulty nodes with arbitrary behaviour, the task is…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-24 Christoph Lenzen , Joel Rybicki , Jukka Suomela

We study the asymmetric matrix factorization problem under a natural nonconvex formulation with arbitrary overparametrization. The model-free setting is considered, with minimal assumption on the rank or singular values of the observed…

Machine Learning · Computer Science 2023-08-22 Liwei Jiang , Yudong Chen , Lijun Ding

We present a notion of bilinear stability, which is to numerical stability what bilinear complexity is to time complexity. In bilinear complexity, an algorithm for evaluating a bilinear operator $\beta : \mathbb{U} \times \mathbb{V} \to…

Numerical Analysis · Mathematics 2023-10-13 Zhen Dai , Lek-Heng Lim

For a manifold $W$ and an $E_d$-algebra $A$, the factorisation homology $\int_W A$ can be seen as a generalisation of the classical configuration space of labelled particles in $W$. It carries an action by the diffeomorphism group…

Algebraic Topology · Mathematics 2025-01-08 Florian Kranhold

The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Xiao Fu , Nico Vervliet , Lieven De Lathauwer , Kejun Huang , Nicolas Gillis

Given a real-valued positive semidefinite matrix, Williamson proved that it can be diagonalised using symplectic matrices. The corresponding diagonal values are known as the symplectic spectrum. This paper is concerned with the stability of…

Spectral Theory · Mathematics 2016-09-07 Martin Idel , Sebatian Soto Gaona , Michael M. Wolf

In this article, we study some parallel processing algorithms for multiplication and modulo operations. We demonstrate that the state transitions that are formed under these algorithms satisfy lattice-linearity, where these algorithms…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-16 Arya Tanmay Gupta , Sandeep S Kulkarni

We study the 'bad science matrix problem': among all matrices $A\in\mathbb{R}^{n\times n}$ whose rows have unit $\ell_2$-norm, determine the maximum of $\beta(A)=\frac{1}{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty$. Steinerberger [1]…

Functional Analysis · Mathematics 2025-09-16 Shridhar Sinha

The multiplicative update (MU) algorithm has been extensively used to estimate the basis and coefficient matrices in nonnegative matrix factorization (NMF) problems under a wide range of divergences and regularizers. However, theoretical…

Optimization and Control · Mathematics 2017-06-08 Renbo Zhao , Vincent Y. F. Tan

The paper aims at constructing two different solutions to an elliptic system $$ u \cdot \nabla u + (-\Delta)^m u = \lambda F $$ defined on the two dimensional torus. It can be viewed as an elliptic regularization of the stationary Burgers…

Analysis of PDEs · Mathematics 2017-12-05 Jacek Cyranka , Piotr Bogusław Mucha

Large language models (LLMs) have shown their power in different areas. Attention computation, as an important subroutine of LLMs, has also attracted interests in theory. Recently the static computation and dynamic maintenance of attention…

Data Structures and Algorithms · Computer Science 2023-04-11 Yichuan Deng , Sridhar Mahadevan , Zhao Song

Let $\mathcal{O} \subset \mathbb{R}^d$ be a bounded domain of class $C^2$. In the Hilbert space $L_2(\mathcal{O};\mathbb{C}^n)$, we consider a matrix elliptic second order differential operator $\mathcal{A}_{D,\varepsilon}$ with the…

Analysis of PDEs · Mathematics 2014-01-14 T. A. Suslina

Consider the use of $\ell_{1}/\ell_{\infty}$-regularized regression for joint estimation of a $\pdim \times \numreg$ matrix of regression coefficients. We analyze the high-dimensional scaling of $\ell_1/\ell_\infty$-regularized quadratic…

Statistics Theory · Mathematics 2009-05-12 S. Negahban , M. J. Wainwright

Following the paradigm of \cite{MR3117742}, we are going to explore the stable transfer factors for $\mathrm{Sym}^{n}$ lifting from $\mathrm{GL}_{2}$ to $\mathrm{GL}_{n+1}$ over any local fields $F$ of characteristic zero with residue…

Representation Theory · Mathematics 2020-02-25 Daniel Johnstone , Zhilin Luo

This paper is devoted to the study of tilt stability of local minimizers, which plays an important role in both theoretical and numerical aspects of optimization. This notion has been comprehensively investigated in the unconstrained…

Optimization and Control · Mathematics 2018-09-12 Matúš Benko , Helmut Gfrerer , Boris S. Mordukhovich