English
Related papers

Related papers: On sketch-and-project methods for solving tensor e…

200 papers

In this paper, we introduce an inertial Tseng's extragradient method for solving multi-valued variational inequalits, in which only one projection is needed at each iterate. We also obtain the strong convergence results of the proposed…

Optimization and Control · Mathematics 2020-11-26 Changjie Fang , Ruirui Zhang , Shenglan Chen

In this paper, we consider the numerical methods preserving single or multiple conserved quantities, and these methods are able to reach high order of strong convergence simultaneously based on some kinds of projection methods. The…

Numerical Analysis · Mathematics 2016-03-22 Weien Zhou , Liying Zhang , Jialin Hong , Songhe Song

In this paper, we investigate the random subsampling method for tensor least squares problem with respect to the popular t-product. From the optimization perspective, we present the error bounds in the sense of probability for the residual…

Numerical Analysis · Mathematics 2022-12-01 Ling Tang , Hanyu Li

Randomized regularized Kaczmarz algorithms have recently been proposed to solve tensor recovery models with {\it consistent} linear measurements. In this work, we propose a novel algorithm based on the randomized extended Kaczmarz algorithm…

Numerical Analysis · Mathematics 2021-12-17 Kui Du , Xiao-Hui Sun

We propose a randomized second-order method for optimization known as the Newton Sketch: it is based on performing an approximate Newton step using a randomly projected or sub-sampled Hessian. For self-concordant functions, we prove that…

Optimization and Control · Mathematics 2015-05-12 Mert Pilanci , Martin J. Wainwright

Sketching, a dimensionality reduction technique, has received much attention in the statistics community. In this paper, we study sketching in the context of Newton's method for solving finite-sum optimization problems in which the number…

Optimization and Control · Mathematics 2019-06-03 Albert S. Berahas , Raghu Bollapragada , Jorge Nocedal

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

We present the first application of quantics tensor trains (QTTs) and tensor cross interpolation (TCI) to the solution of a full set of self-consistent equations for multivariate functions, the so-called parquet equations. We show that the…

Strongly Correlated Electrons · Physics 2025-04-29 Stefan Rohshap , Marc K. Ritter , Hiroshi Shinaoka , Jan von Delft , Markus Wallerberger , Anna Kauch

We consider stochastic variational inequalities with monotone operators defined as the expected value of a random operator. We assume the feasible set is the intersection of a large family of convex sets. We propose a method that combines…

Optimization and Control · Mathematics 2017-03-03 Alfredo Iusem , Alejandro Jofré , Philip Thompson

Higher order tensor inversion is possible for even order. We have shown that a tensor group endowed with the Einstein (contracted) product is isomorphic to the general linear group of degree $n$. With the isomorphic group structures, we…

Numerical Analysis · Mathematics 2011-09-20 Michael Brazell , Na Li , Carmeliza Navasca , Christino Tamon

In this paper we develop an adaptive procedure for the numerical solution of general, semilinear elliptic problems with possible singular perturbations. Our approach combines both a prediction-type adaptive Newton method and an adaptive…

Numerical Analysis · Mathematics 2014-08-27 Mario Amrein , Thomas P. Wihler

This paper presents a method for the accurate and efficient computations on scalar, vector and tensor fields in three-dimensional spherical polar coordinates. The methods uses spin-weighted spherical harmonics in the angular directions and…

Numerical Analysis · Mathematics 2018-04-30 Geoff Vasil , Daniel Lecoanet , Keaton Burns , Jeff Oishi , Ben Brown

In this paper, we propose the first sketch-and-project Newton method with fast $\mathcal O(k^{-2})$ global convergence rate for self-concordant functions. Our method, SGN, can be viewed in three ways: i) as a sketch-and-project algorithm…

Optimization and Control · Mathematics 2024-05-28 Slavomír Hanzely

A three-point iterative method for solving scalar non-linear equations was selected and then adapted to solve systems of non-linear equations. Subsequently, by applying Taylor's theorem to functions of $\R^{n}$ in $\R^{n}$, it is shown that…

General Mathematics · Mathematics 2026-01-23 Carlos E. Cadenas R. , Yorman J. Mendoza N

Explicit step-truncation tensor methods have recently proven successful in integrating initial value problems for high-dimensional partial differential equations (PDEs). However, the combination of non-linearity and stiffness may introduce…

Numerical Analysis · Mathematics 2023-03-21 Abram Rodgers , Daniele Venturi

This work addresses a central challenge in the numerical analysis of the cutoff spatially homogeneous Boltzmann equation: the development of rigorously justified, accurate numerical schemes. We present (i) a novel Fourier spectral method…

Numerical Analysis · Mathematics 2026-03-30 Yanzhi Gui , Ling-Bing He , Liu Liu

In this paper, we propose a dimension reduction method specifically designed for tensor-structured feature data in deep neural networks. The method is implemented as a hidden layer, called the TensorProjection layer, which transforms input…

Machine Learning · Statistics 2024-10-23 Toshinari Morimoto , Su-Yun Huang

In the tensor completion problem, one seeks to estimate a low-rank tensor based on a random sample of revealed entries. In terms of the required sample size, earlier work revealed a large gap between estimation with unbounded computational…

Data Structures and Algorithms · Computer Science 2016-12-26 Andrea Montanari , Nike Sun

The estimation of correspondences between two images resp. point sets is a core problem in computer vision. One way to formulate the problem is graph matching leading to the quadratic assignment problem which is NP-hard. Several so called…

Computer Vision and Pattern Recognition · Computer Science 2015-05-01 Quynh Nguyen , Antoine Gautier , Matthias Hein

A stochastic gradient method for finite-sum minimization subject to deterministic linear constraints is proposed and analyzed. The procedure presented adapts the projected gradient method on convex set to the use of both a stochastic…

Optimization and Control · Mathematics 2026-05-19 Natasa Krklec Jerinkic , Benedetta Morini , Mahsa Yousefi