English
Related papers

Related papers: Adaptive Matrix Sparsification and Applications to…

200 papers

Large language models (LLMs) have shown their power in different areas. Attention computation, as an important subroutine of LLMs, has also attracted interests in theory. Recently the static computation and dynamic maintenance of attention…

Data Structures and Algorithms · Computer Science 2023-04-11 Yichuan Deng , Sridhar Mahadevan , Zhao Song

In stochastic optimization, the population risk is generally approximated by the empirical risk. However, in the large-scale setting, minimization of the empirical risk may be computationally restrictive. In this paper, we design an…

Machine Learning · Statistics 2016-11-22 Murat A. Erdogdu , Mohsen Bayati , Lee H. Dicker

Focusing on stochastic programming (SP) with covariate information, this paper proposes an empirical risk minimization (ERM) method embedded within a nonconvex piecewise affine decision rule (PADR), which aims to learn the direct mapping…

Optimization and Control · Mathematics 2025-09-29 Yiyang Zhang , Junyi Liu , Xiaobo Zhao

We give a new framework for solving the fundamental problem of low-rank matrix completion, i.e., approximating a rank-$r$ matrix $\mathbf{M} \in \mathbb{R}^{m \times n}$ (where $m \ge n$) from random observations. First, we provide an…

Machine Learning · Computer Science 2023-08-08 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

The sparse matrix compression problem asks for a one-dimensional representation of a binary $n \times \ell$ matrix, formed by an integer array of row indices and a shift function for each row, such that accessing a matrix entry is possible…

Data Structures and Algorithms · Computer Science 2026-02-18 Vincent Jugé , Dominik Köppl , Vincent Limouzy , Andrea Marino , Jannik Olblich , Giulia Punzi , Takeaki Uno

Many convex problems in machine learning and computer science share the same form: \begin{align*} \min_{x} \sum_{i} f_i( A_i x + b_i), \end{align*} where $f_i$ are convex functions on $\mathbb{R}^{n_i}$ with constant $n_i$, $A_i \in…

Data Structures and Algorithms · Computer Science 2019-05-14 Yin Tat Lee , Zhao Song , Qiuyi Zhang

Empirical risk minimization (ERM) and distributionally robust optimization (DRO) are popular approaches for solving stochastic optimization problems that appear in operations management and machine learning. Existing generalization error…

Optimization and Control · Mathematics 2023-09-26 Garud Iyengar , Henry Lam , Tianyu Wang

Graphs arising in statistical problems, signal processing, large networks, combinatorial optimization, and data analysis are often dense, which causes both computational and storage bottlenecks. One way of \textit{sparsifying} a…

Numerical Analysis · Mathematics 2023-04-27 Neophytos Charalambides , Alfred O. Hero

We propose a communication- and computation-efficient distributed optimization algorithm using second-order information for solving ERM problems with a nonsmooth regularization term. Current second-order and quasi-Newton methods for this…

Optimization and Control · Mathematics 2018-05-29 Ching-pei Lee , Cong Han Lim , Stephen J. Wright

Given vectors $v_1,\dots,v_n\in\mathbb{R}^d$ and a matroid $M=([n],I)$, we study the problem of finding a basis $S$ of $M$ such that $\det(\sum_{i \in S}v_i v_i^\top)$ is maximized. This problem appears in a diverse set of areas such as…

Data Structures and Algorithms · Computer Science 2020-04-20 Vivek Madan , Aleksandar Nikolov , Mohit Singh , Uthaipon Tantipongpipat

We propose an efficient ADMM method with guarantees for high-dimensional problems. We provide explicit bounds for the sparse optimization problem and the noisy matrix decomposition problem. For sparse optimization, we establish that the…

Machine Learning · Computer Science 2015-07-08 Hanie Sedghi , Anima Anandkumar , Edmond Jonckheere

We study the detailed path-wise behavior of the discrete-time Langevin algorithm for non-convex Empirical Risk Minimization (ERM) through the lens of metastability, adopting some techniques from Berglund and Gentz (2003. For a particular…

Machine Learning · Computer Science 2020-07-27 Belinda Tzen , Tengyuan Liang , Maxim Raginsky

Sparsity finds applications in areas as diverse as statistics, machine learning, and signal processing. Computations over sparse structures are less complex compared to their dense counterparts, and their storage consumes less space. This…

Signal Processing · Electrical Eng. & Systems 2023-01-31 Omar M. Sleem , M. E. Ashour , N. S. Aybat , Constantino M. Lagoa

Exponential tilting is a technique commonly used in fields such as statistics, probability, information theory, and optimization to create parametric distribution shifts. Despite its prevalence in related fields, tilting has not seen…

Machine Learning · Computer Science 2023-06-02 Tian Li , Ahmad Beirami , Maziar Sanjabi , Virginia Smith

Randomized matrix sparsification has proven to be a fruitful technique for producing faster algorithms in applications ranging from graph partitioning to semidefinite programming. In the decade or so of research into this technique, the…

Numerical Analysis · Mathematics 2009-11-23 Alex Gittens , Joel A. Tropp

Given an $n*n$ sparse symmetric matrix with $m$ nonzero entries, performing Gaussian elimination may turn some zeroes into nonzero values. To maintain the matrix sparse, we would like to minimize the number $k$ of these changes, hence…

Computational Complexity · Computer Science 2016-06-28 Yixin Cao , R. B. Sandeep

In this paper, the solution to the empirical risk minimization problem with $f$-divergence regularization (ERM-$f$DR) is presented and conditions under which the solution also serves as the solution to the minimization of the expected…

Machine Learning · Statistics 2026-01-21 Francisco Daunas , Iñaki Esnaola , Samir M. Perlaza , H. Vincent Poor

The ability to generalize under distributional shifts is essential to reliable machine learning, while models optimized with empirical risk minimization usually fail on non-$i.i.d$ testing data. Recently, invariant learning methods for…

Machine Learning · Computer Science 2021-10-26 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

We present a new algorithm for finding a near optimal low-rank approximation of a matrix $A$ in $O(nnz(A))$ time. Our method is based on a recursive sampling scheme for computing a representative subset of $A$'s columns, which is then used…

Data Structures and Algorithms · Computer Science 2016-10-10 Michael B. Cohen , Cameron Musco , Christopher Musco

Machine learning models traditionally assume that training and test data are independently and identically distributed. However, in real-world applications, the test distribution often differs from training. This problem, known as…

Machine Learning · Computer Science 2024-06-19 Kotaro Yoshida , Hiroki Naganuma