English
Related papers

Related papers: Random Linear Systems with Quadratic Constraints: …

200 papers

We derive computationally tractable formulations of the robust counterparts of convex quadratic and conic quadratic constraints that are concave in matrix-valued uncertain parameters. We do this for a broad range of uncertainty sets. In…

Optimization and Control · Mathematics 2022-04-07 Ahmadreza Marandi , Aharon Ben-Tal , Dick den Hertog , Bertrand Melenberg

We are interested in finding a solution to the tensor complementarity problem with a strong M-tensor, which we call the M-tensor complementarity problem. We propose a lower dimensional linear equation approach to solve that problem. At each…

Optimization and Control · Mathematics 2020-07-28 Dong-Hui Li , Cui-Dan Chen , Hong-Bo Guan

Large systems of linear equations are ubiquitous in science. Quite often, e.g. when considering population dynamics or chemical networks, the solutions must be non-negative. Recently, it has been shown that large systems of random linear…

Disordered Systems and Neural Networks · Physics 2020-07-01 Stefan Landmann , Andreas Engel

In this era of large-scale data, distributed systems built on top of clusters of commodity hardware provide cheap and reliable storage and scalable processing of massive data. Here, we review recent work on developing and implementing…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-28 Jiyan Yang , Xiangrui Meng , Michael W. Mahoney

In this paper, we propose a federated algorithm for solving large linear systems that is inspired by the classic randomized Kaczmarz algorithm. We provide convergence guarantees of the proposed method, and as a corollary of our analysis, we…

Numerical Analysis · Mathematics 2025-05-15 Halyun Jeong , Deanna Needell , Chi-Hao Wu

This paper considers the problem of matrix-variate logistic regression. It derives the fundamental error threshold on estimating low-rank coefficient matrices in the logistic regression problem by obtaining a lower bound on the minimax…

Machine Learning · Computer Science 2022-05-10 Batoul Taki , Mohsen Ghassemi , Anand D. Sarwate , Waheed U. Bajwa

In [Steinerberger, Q. Appl. Math., 79:3, 419-429, 2021] and [Shao, SIAM J. Matrix Anal. Appl. 44(1), 212-239, 2023], two new types of Kaczmarz algorithms, which share some similarities, for consistent linear systems were proposed. These two…

Numerical Analysis · Mathematics 2024-07-30 Changpeng Shao

Constrained optimization problems appear in a wide variety of challenging real-world problems, where constraints often capture the physics of the underlying system. Classic methods for solving these problems rely on iterative algorithms…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Meiyi Li , Soheil Kolouri , Javad Mohammadi

The Kaczmarz algorithm is an iterative method for solving systems of linear equations. We introduce a modified Kaczmarz algorithm for solving systems of linear equations in a distributed environment, i.e. the equations within the system are…

Numerical Analysis · Mathematics 2019-04-12 Chinmay Hegde , Fritz Keinert , Eric S. Weber

We consider a high-dimensional random constrained optimization problem in which a set of binary variables is subjected to a linear system of equations. The cost function is a simple linear cost, measuring the Hamming distance with respect…

Disordered Systems and Neural Networks · Physics 2022-11-23 Alfredo Braunstein , Louise Budzynski , Stefano Crotti , Federico Ricci-Tersenghi

In this paper, we will present a generalization for a minimization problem from I. Daubechies, M. Defrise, and C. Demol [3]. This generalization is useful for solving many practical problems in which more than one constraint are involved.…

Optimization and Control · Mathematics 2019-12-20 Saman Khoramian

Scattering of electromagnetic waves in billiard-like systems has become a standard experimental tool of studying properties associated with Quantum Chaos. Random Matrix Theory (RMT) describing statistics of eigenfrequencies and associated…

Disordered Systems and Neural Networks · Physics 2021-05-11 Yan V Fyodorov

We present new iterative algorithms for solving a square linear system $Ax=b$ in dimension $n$ by employing the {\it Triangle Algorithm} \cite{kal12}, a fully polynomial-time approximation scheme for testing if the convex hull of a finite…

Numerical Analysis · Computer Science 2012-10-31 Bahman Kalantari

In this paper, a class of optimization problems with nonlinear inequality constraints is discussed. Based on the ideas of sequential quadratic programming algorithm and the method of strongly sub-feasible directions, a new superlinearly…

Optimization and Control · Mathematics 2012-06-28 Jin-Bao Jian , Chuan-Hao Guo , Chun-Ming Tang , Yan-Qin Bai

One of the distinguishing characteristics of modern deep learning systems is that they typically employ neural network architectures that utilize enormous numbers of parameters, often in the millions and sometimes even in the billions.…

Machine Learning · Statistics 2021-11-15 Ben Adlam , Jake Levinson , Jeffrey Pennington

This short course offers a new perspective on randomized algorithms for matrix computations. It explores the distinct ways in which probability can be used to design algorithms for numerical linear algebra. Each design template is…

Numerical Analysis · Mathematics 2025-09-23 Anastasia Kireeva , Joel A. Tropp

In covariance matrix estimation, one of the challenges lies in finding a suitable model and an efficient estimation method. Two commonly used modelling approaches in the literature involve imposing linear restrictions on the covariance…

Statistics Theory · Mathematics 2024-05-09 Piotr Zwiernik

Univariate and multivariate general linear regression models, subject to linear inequality constraints, arise in many scientific applications. The linear inequality restrictions on model parameters are often available from phenomenological…

Methodology · Statistics 2021-12-07 Solmaz Seifollahi , Kaniav Kamary , Hossein Bevrani

Quadratic matrix equations of the kind $A_1X^2+A_0X+A_{-1}=X$ are encountered in the analysis of Quasi--Birth-Death stochastic processes where the solution of interest is the minimal nonnegative solution $G$. In many queueing models,…

Numerical Analysis · Mathematics 2021-01-25 Dario A. Bini , Beatrice Meini , Jie Meng

We study quasi-convex optimization problems, where only a subset of the constraints can be sampled, and yet one would like a probabilistic guarantee on the obtained solution with respect to the initial (unknown) optimization problem. Even…

Optimization and Control · Mathematics 2021-01-06 Guillaume O. Berger , Raphaël M. Jungers , Zheming Wang