English
Related papers

Related papers: Randomized algorithms for distributed computation …

200 papers

Discrete stochastic processes (DSP) are instrumental for modelling the dynamics of probabilistic systems and have a wide spectrum of applications in science and engineering. DSPs are usually analyzed via Monte Carlo methods since the number…

Quantum Physics · Physics 2020-08-17 Carsten Blank , Daniel K. Park , Francesco Petruccione

Problems with solutions represented by permutations are very prominent in combinatorial optimization. Thus, in recent decades, a number of evolutionary algorithms have been proposed to solve them, and among them, those based on probability…

Neural and Evolutionary Computing · Computer Science 2023-04-06 Valentino Santucci , Josu Ceberio

This paper aims to address distributed optimization problems over directed and time-varying networks, where the global objective function consists of a sum of locally accessible convex objective functions subject to a feasible set…

Optimization and Control · Mathematics 2020-07-14 Xiuxian Li , Gang Feng , Lihua Xie

The principal support vector machines method (Li et al., 2011) is a powerful tool for sufficient dimension reduction that replaces original predictors with their low-dimensional linear combinations without loss of information. However, the…

Machine Learning · Statistics 2019-12-02 Jun Jin , Chao Ying , Zhou Yu

Large matrices arise in many machine learning and data analysis applications, including as representations of datasets, graphs, model weights, and first and second-order derivatives. Randomized Numerical Linear Algebra (RandNLA) is an area…

Machine Learning · Computer Science 2024-06-21 Michał Dereziński , Michael W. Mahoney

The goal of decentralized optimization over a network is to optimize a global objective formed by a sum of local (possibly nonsmooth) convex functions using only local computation and communication. It arises in various application domains,…

Optimization and Control · Mathematics 2015-03-17 John Duchi , Alekh Agarwal , Martin Wainwright

Eigenvectors of matrices on a network have been used for understanding spectral clustering and influence of a vertex. For matrices with small geodesic-width, we propose a distributed iterative algorithm in this letter to find eigenvectors…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-24 Nazar Emirov , Cheng Cheng , Qiyu Sun , Zhihua Qu

This paper is about how to partition decision variables while decomposing a large-scale optimization problem for the best performance of distributed solution methods. Solving a large-scale optimization problem sequen- tially can be…

Optimization and Control · Mathematics 2017-10-26 Yuchen Zheng , Ilbin Lee , Nicoleta Serban

Several problems in modeling and control of stochastically-driven dynamical systems can be cast as regularized semi-definite programs. We examine two such representative problems and show that they can be formulated in a similar manner. The…

Optimization and Control · Mathematics 2019-12-30 Armin Zare , Hesameddin Mohammadi , Neil K. Dhingra , Tryphon T. Georgiou , Mihailo R. Jovanović

We consider an $n$ agents distributed optimization problem with imperfect information characterized in a parametric sense, where the unknown parameter can be solved by a distinct distributed parameter learning problem. Though each agent…

Optimization and Control · Mathematics 2024-04-23 Yaqun Yang , Jinlong Lei

In this paper, we combine the operator splitting methodology for abstract evolution equations with that of stochastic methods for large-scale optimization problems. The combination results in a randomized splitting scheme, which in a given…

Numerical Analysis · Mathematics 2022-10-12 Monika Eisenmann , Tony Stillfjord

When developing a software system, a change in one part of the system may lead to unwanted changes in other parts of the system. These affected parts may interfere with system performance, so regression testing is used to deal with these…

Software Engineering · Computer Science 2024-05-13 Mahdi Movahedian Moghaddam

Singular Value Decomposition (SVD) is a powerful tool for multivariate analysis. However, independent computation of the SVD for each sample taken from a bandlimited matrix random process will result in singular value sample paths whose…

Statistics Theory · Mathematics 2007-06-13 D. W. Browne , M. W. Browne , M. P. Fitz

In this paper we consider a novel partitioned framework for distributed optimization in peer-to-peer networks. In several important applications the agents of a network have to solve an optimization problem with two key features: (i) the…

Systems and Control · Computer Science 2018-05-23 Ivano Notarnicola , Ruggero Carli , Giuseppe Notarstefano

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

Machine Learning · Statistics 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf

Several high-throughput distributed data-processing applications require multi-hop processing of streams of data. These applications include continual processing on data streams originating from a network of sensors, composing a multimedia…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-03-26 Shah Asaduzzaman , Muthucumaru Maheswaran

Chance-constrained programming (CCP) is one of the most difficult classes of optimization problems that has attracted the attention of researchers since the 1950s. In this survey, we focus on cases when only a limited information on the…

Optimization and Control · Mathematics 2022-02-15 Simge Küçükyavuz , Ruiwei Jiang

Low-rank approximation of a matrix by means of structured random sampling has been consistently efficient in its extensive empirical studies around the globe, but adequate formal support for this empirical phenomenon has been missing so…

Numerical Analysis · Mathematics 2016-07-21 Victor Pan , John Svadlenka , Liang Zhao

Randomization is a fundamental tool used in many theoretical and practical areas of computer science. We study here the role of randomization in the area of submodular function maximization. In this area most algorithms are randomized, and…

Data Structures and Algorithms · Computer Science 2015-08-11 Niv Buchbinder , Moran Feldman

Randomized Numerical Linear Algebra (RandNLA) uses randomness to develop improved algorithms for matrix problems that arise in scientific computing, data science, machine learning, etc. Determinantal Point Processes (DPPs), a seemingly…

Data Structures and Algorithms · Computer Science 2020-05-08 Michał Dereziński , Michael W. Mahoney