English
Related papers

Related papers: On subdifferential chain rule of matrix factorizat…

200 papers

Sparse coding--that is, modelling data vectors as sparse linear combinations of basis elements--is widely used in machine learning, neuroscience, signal processing, and statistics. This paper focuses on the large-scale matrix factorization…

Machine Learning · Statistics 2010-02-11 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro

We develop a unified and systematic framework for performing online nonnegative matrix factorization under a wide variety of important divergences. The online nature of our algorithm makes it particularly amenable to large-scale data. We…

Machine Learning · Statistics 2016-08-17 Renbo Zhao , Vincent Y. F. Tan , Huan Xu

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

This article investigates the existence, nonexistence, and multiplicity of positive solutions to the sublinear fractional elliptic problem $(P_{\lambda}^s)$. We begin by establishing several a priori estimates that provide regularity…

Analysis of PDEs · Mathematics 2025-11-12 Jefferson Abrantes , Rohit Kumar , Abhishek Sarkar

We investigate the problem of factorizing a matrix into several sparse matrices and propose an algorithm for this under randomness and sparsity assumptions. This problem can be viewed as a simplification of the deep learning problem where…

Machine Learning · Computer Science 2014-05-14 Behnam Neyshabur , Rina Panigrahy

Matrix factorization methods are important tools in data mining and analysis. They can be used for many tasks, ranging from dimensionality reduction to visualization. In this paper we concentrate on the use of matrix factorizations for…

Machine Learning · Computer Science 2017-07-28 Sanjar Karaev , Pauli Miettinen

Matrix factorization is a popular approach for large-scale matrix completion. The optimization formulation based on matrix factorization can be solved very efficiently by standard algorithms in practice. However, due to the non-convexity…

Machine Learning · Computer Science 2016-11-18 Ruoyu Sun , Zhi-Quan Luo

Max-cut, clustering, and many other partitioning problems that are of significant importance to machine learning and other scientific fields are NP-hard, a reality that has motivated researchers to develop a wealth of approximation…

Data Structures and Algorithms · Computer Science 2018-10-17 Maria-Florina Balcan , Vaishnavh Nagarajan , Ellen Vitercik , Colin White

This paper is concerned with the problem of representing and learning a linear transformation using a linear neural network. In recent years, there has been a growing interest in the study of such networks in part due to the successes of…

Optimization and Control · Mathematics 2017-09-28 Amirhossein Taghvaei , Jin W. Kim , Prashant G. Mehta

It is well known that in a supervised classification setting when the number of features is smaller than the number of observations, Fisher's linear discriminant rule is asymptotically Bayes. However, there are numerous modern applications…

Machine Learning · Statistics 2014-09-17 Irina Gaynanova , James G. Booth , Martin T. Wells

We investigate compressibility of the dimension of positive semidefinite matrices while approximately preserving their pairwise inner products. This can either be regarded as compression of positive semidefinite factorizations of…

Quantum Physics · Physics 2016-05-06 Cyril J. Stark , Aram W. Harrow

Low-rank matrix factorizations are a class of linear models widely used in various fields such as machine learning, signal processing, and data analysis. These models approximate a matrix as the product of two smaller matrices, where the…

Machine Learning · Computer Science 2024-12-10 Olivier Vu Thanh

Lattices are a popular field of study in mathematical research, but also in more practical areas like cryptology or multiple-input/multiple-output (MIMO) transmission. In mathematical theory, most often lattices over real numbers are…

Information Theory · Computer Science 2022-08-19 Sebastian Stern , Cong Ling , Robert F. H. Fischer

We provide the classical Boundary Harnack principle in Lipschitz domains for solutions to two different linear uniformly elliptic equations with the same principal part.

Analysis of PDEs · Mathematics 2025-07-04 Daniela De Silva , Ovidiu Savin

The sparse factorization of a large matrix is fundamental in modern statistical learning. In particular, the sparse singular value decomposition and its variants have been utilized in multivariate regression, factor analysis, biclustering,…

Machine Learning · Statistics 2020-03-19 Kun Chen , Ruipeng Dong , Wanwan Xu , Zemin Zheng

We explore the connection between the factorisation of virtual corrections to multi-particle massless gauge theory amplitudes and the problem of subtraction at NNLO and beyond. Taking inspiration from virtual factorisation, we provide a set…

High Energy Physics - Phenomenology · Physics 2018-01-22 Lorenzo Magnea , Ezio Maina , Paolo Torrielli , Sandro Uccirati

Starting from the Riemann-Liouville derivative, many authors have built their own notion of fractional derivative in order to avoid some classical difficulties like a non zero derivative for a constant function or a rather complicated…

Classical Analysis and ODEs · Mathematics 2016-07-12 Jacky Cresson , Anna Szafrańska

We develop physically admissible lattice models in the harmonic approximation which define by Hamilton's variational principle fractional Laplacian matrices of the forms of power law matrix functions on the n -dimensional periodic and…

Mathematical Physics · Physics 2016-10-13 T. M. Michelitsch , B. A. Collet , A. P. Riascos , A. F. Nowakowski , F. C. G. A. Nicolleau

Matrix factorization is an inference problem that has acquired importance due to its vast range of applications that go from dictionary learning to recommendation systems and machine learning with deep networks. The study of its fundamental…

Disordered Systems and Neural Networks · Physics 2023-08-01 Francesco Camilli , Marc Mézard

This expository paper contains a concise introduction to some significant works concerning the Karush-Kuhn-Tucker condition, a necessary condition for a solution in local optimality in problems with equality and inequality constraints. The…

Optimization and Control · Mathematics 2020-06-08 Zhuoyu Xiao