English
Related papers

Related papers: A scalable system for primal-dual optimization

200 papers

Classification in the dissimilarity space has become a very active research area since it provides a possibility to learn from data given in the form of pairwise non-metric dissimilarities, which otherwise would be difficult to cope with.…

In this paper, we study the two-stage distributionally robust optimization (DRO) problem from the primal perspective. Unlike existing approaches, this perspective allows us to build a deeper and more intuitive understanding on DRO, to…

Optimization and Control · Mathematics 2024-12-31 Zhengsong Lu , Bo Zeng

In this paper we propose a stochastic primal dual fixed point method (SPDFP) for solving the sum of two proper lower semi-continuous convex function and one of which is composite. The method is based on the primal dual fixed point method…

Optimization and Control · Mathematics 2020-04-21 YaNanZhu , XiaoqunZhang

This work provides simple algorithms for multi-class (and multi-label) prediction in settings where both the number of examples n and the data dimension d are relatively large. These robust and parameter free algorithms are essentially…

Machine Learning · Computer Science 2013-10-22 Alekh Agarwal , Sham M. Kakade , Nikos Karampatziakis , Le Song , Gregory Valiant

Model Predictive Control (MPC) is a versatile approach capable of accommodating diverse control requirements that holds significant promise for a broad spectrum of industrial applications. Noteworthy challenges associated with MPC include…

Systems and Control · Electrical Eng. & Systems 2025-04-28 Ryuta Moriyasu , Sho Kawaguchi , Kenji Kashima

We study the linear convergence of the primal-dual hybrid gradient method. After a review of current analyses, we show that they do not explain properly the behavior of the algorithm, even on the most simple problems. We thus introduce the…

Optimization and Control · Mathematics 2023-04-25 Olivier Fercoq

This survey article reviews the challenges associated with deploying and optimizing big data applications and machine learning algorithms in cloud data centers and networks. The MapReduce programming model and its widely-used open-source…

Networking and Internet Architecture · Computer Science 2019-10-03 Sanaa Hamid Mohamed , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

The operation of large-scale infrastructure networks requires scalable optimization schemes. To guarantee safe system operation, a high degree of feasibility in a small number of iterations is important. Decomposition schemes can help to…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Alexander Engelmann , Sungho Shin , François Pacaud , Victor M. Zavala

We present a new connection between self-adjusting binary search trees (BSTs) and heaps, two fundamental, extensively studied, and practically relevant families of data structures. Roughly speaking, we map an arbitrary heap algorithm within…

Data Structures and Algorithms · Computer Science 2019-01-01 László Kozma , Thatchaphol Saranurak

We consider a primal-dual algorithm for minimizing $f(x)+h\square l(Ax)$ with Fr\'echet differentiable $f$ and $l^*$. This primal-dual algorithm has two names in literature: Primal-Dual Fixed-Point algorithm based on the Proximity Operator…

Optimization and Control · Mathematics 2021-02-02 Zhi Li , Ming Yan

In an effort to overcome the data deluge in computational biology and bioinformatics and to facilitate bioinformatics research in the era of big data, we identify some of the most influential algorithms that have been widely used in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-03 Faraz Faghri , Sayed Hadi Hashemi , Mohammad Babaeizadeh , Mike A. Nalls , Saurabh Sinha , Roy H. Campbell

Markov decision processes (MDP) are useful to model concurrent process optimisation problems, but verifying them with numerical methods is often intractable. Existing approximative approaches do not scale well and are limited to memoryless…

Data Structures and Algorithms · Computer Science 2014-09-18 Axel Legay , Sean Sedwards , Louis-Marie Traonouez

Hadoop is emerging as the primary data hub in enterprises, and SQL represents the de facto language for data analysis. This combination has led to the development of a variety of SQL-on-Hadoop systems in use today. While the various…

Databases · Computer Science 2018-04-03 Ashish Tapdiya , Daniel Fabbri

When training large machine learning models with many variables or parameters, a single machine is often inadequate since the model may be too large to fit in memory, while training can take a long time even with stochastic updates. A…

Machine Learning · Statistics 2014-06-19 Seunghak Lee , Jin Kyu Kim , Xun Zheng , Qirong Ho , Garth A. Gibson , Eric P. Xing

We engineer algorithms for sorting huge data sets on massively parallel machines. The algorithms are based on the multiway merging paradigm. We first outline an algorithm whose I/O requirement is close to a lower bound. Thus, in contrast to…

Data Structures and Algorithms · Computer Science 2009-10-15 Mirko Rahn , Peter Sanders , Johannes Singler

Generalized sparse matrix-matrix multiplication is a key primitive for many high performance graph algorithms as well as some linear solvers such as multigrid. We present the first parallel algorithms that achieve increasing speedups for an…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-09 Aydın Buluç , John R. Gilbert

The domain of online algorithms with predictions has been extensively studied for different applications such as scheduling, caching (paging), clustering, ski rental, etc. Recently, Bamas et al., aiming for an unified method, have provided…

Data Structures and Algorithms · Computer Science 2021-10-04 Nguyen Kim Thang , Christoph Durr

We propose a new primal-dual homotopy smoothing algorithm for a linearly constrained convex program, where neither the primal nor the dual function has to be smooth or strongly convex. The best known iteration complexity solving such a…

Optimization and Control · Mathematics 2018-10-25 Xiaohan Wei , Hao Yu , Qing Ling , Michael J. Neely

We introduce a primal-dual stochastic gradient oracle method for distributed convex optimization problems over networks. We show that the proposed method is optimal in terms of communication steps. Additionally, we propose a new analysis…

Optimization and Control · Mathematics 2019-11-28 Darina Dvinskikh , Eduard Gorbunov , Alexander Gasnikov , Pavel Dvurechensky , Cesar A. Uribe

We present experimental work on a primal-dual framework simultaneously approximating maximum cut and weighted fractional cut-covering instances. In this primal-dual framework, we solve a semidefinite programming (SDP) relaxation to either…

Optimization and Control · Mathematics 2026-04-21 Nathan Benedetto Proença , Marcel K. de Carli Silva , Cristiane M. Sato , Levent Tunçel