English
Related papers

Related papers: Shrunk subspaces via operator Sinkhorn iteration

200 papers

We study efficient solution methods for stochastic eigenvalue problems arising from discretization of self-adjoint partial differential equations with random data. With the stochastic Galerkin approach, the solutions are represented as…

Numerical Analysis · Mathematics 2018-03-13 Howard C. Elman , Tengfei Su

We consider the rank reduction problem for matroids: Given a matroid M and an integer k, find a minimum size subset of elements of M whose removal reduces the rank of M by at least k. When M is a graphical matroid this problem is the…

Data Structures and Algorithms · Computer Science 2021-12-23 Gwenaël Joret , Adrian Vetta

Low-rank approximation is a technique to approximate a tensor or a matrix with a reduced rank to reduce the memory required and computational cost for simulation. Its broad applications include dimension reduction, signal processing,…

Computational Physics · Physics 2019-06-25 Zhuogang Peng , Ryan G. McClarren , Martin Frank

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

This paper presents consideration of the Semi-Relaxed Sinkhorn (SR-Sinkhorn) algorithm for the semi-relaxed optimal transport (SROT) problem, which relaxes one marginal constraint of the standard OT problem. For evaluation of how the…

Machine Learning · Computer Science 2022-05-30 Takumi Fukunaga , Hiroyuki Kasai

We compute a \emph{sparse} solution to the classical least-squares problem $\min_x||A x -b||,$ where $A$ is an arbitrary matrix. We describe a novel algorithm for this sparse least-squares problem. The algorithm operates as follows: first,…

Data Structures and Algorithms · Computer Science 2013-12-31 Christos Boutsidis , Malik Magdon-Ismail

The {\sc $c$-Balanced Separator} problem is a graph-partitioning problem in which given a graph $G$, one aims to find a cut of minimum size such that both the sides of the cut have at least $cn$ vertices. In this paper, we present new…

Data Structures and Algorithms · Computer Science 2009-07-10 Manjish Pal

We study low-rank estimation of an unknown sparse graphon from sampled network data under operator-norm loss, motivated by targeted interventions in graphon games. Starting from the observed adjacency matrix, we construct low-rank…

Statistics Theory · Mathematics 2026-04-21 Olga Klopp , Fedor Noskov

Recently, Musco and Woodruff (FOCS, 2017) showed that given an $n \times n$ positive semidefinite (PSD) matrix $A$, it is possible to compute a $(1+\epsilon)$-approximate relative-error low-rank approximation to $A$ by querying…

Data Structures and Algorithms · Computer Science 2021-06-16 Ainesh Bakshi , Nadiia Chepurko , David P. Woodruff

In contrast with many other convex optimization classes, state-of-the-art semidefinite programming solvers are yet unable to efficiently solve large scale instances. This work aims to reduce this scalability gap by proposing a novel…

Optimization and Control · Mathematics 2018-12-20 Mario Souto , Joaquim D. Garcia , Alvaro Veiga

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

Constrained submodular maximization problems have long been studied, with near-optimal results known under a variety of constraints when the submodular function is monotone. The case of non-monotone submodular maximization is less…

Data Structures and Algorithms · Computer Science 2010-10-07 Anupam Gupta , Aaron Roth , Grant Schoenebeck , Kunal Talwar

We introduce a low-rank framework for adaptive isogeometric analysis with truncated hierarchical B-splines (THB-splines) that targets the main bottleneck of local refinement: memory- and time-intensive matrix assembly once the global…

Numerical Analysis · Mathematics 2025-09-12 Tom-Christian Riemer , Martin Stoll

Spectral clustering is a fundamental technique in the field of data mining and information processing. Most existing spectral clustering algorithms integrate dimensionality reduction into the clustering process assisted by manifold learning…

Machine Learning · Computer Science 2014-11-25 Xiaojun Chang , Feiping Nie , Zhigang Ma , Yi Yang , Xiaofang Zhou

This paper introduces a simple principle for robust high-dimensional statistical inference via an appropriate shrinkage on the data. This widens the scope of high-dimensional techniques, reducing the moment conditions from sub-exponential…

Statistics Theory · Mathematics 2017-05-08 Jianqing Fan , Weichen Wang , Ziwei Zhu

In this paper, we present a new ellipsoid-type algorithm for solving nonsmooth problems with convex structure. Examples of such problems include nonsmooth convex minimization problems, convex-concave saddle-point problems and variational…

Optimization and Control · Mathematics 2021-06-28 Anton Rodomanov , Yurii Nesterov

In distribution compression, one aims to accurately summarize a probability distribution $\mathbb{P}$ using a small number of representative points. Near-optimal thinning procedures achieve this goal by sampling $n$ points from a Markov…

Machine Learning · Statistics 2022-10-19 Abhishek Shetty , Raaz Dwivedi , Lester Mackey

In this paper, we propose an exact general algorithm for solving non-convex optimization problems, where the non-convexity arises due to the presence of an inverse S-shaped function. The proposed method involves iteratively approximating…

Optimization and Control · Mathematics 2023-07-27 Arka Das , Ankur Sinha , Sachin Jayaswal

In this paper, we investigate optimization problems with nonnegative and orthogonal constraints, where any feasible matrix of size $n \times p$ exhibits a sparsity pattern such that each row accommodates at most one nonzero entry. Our…

Optimization and Control · Mathematics 2025-11-06 Lei Wang , Xin Liu , Xiaojun Chen

In this paper, we consider the optimization problem Submodular Cover (SCP), which is to find a minimum cardinality subset of a finite universe $U$ such that the value of a submodular function $f$ is above an input threshold $\tau$. In…

Data Structures and Algorithms · Computer Science 2023-09-27 Wenjing Chen , Victoria G. Crawford