English
Related papers

Related papers: A Convergent Single-Loop Algorithm for Relaxation …

200 papers

We consider the exact continuous relaxation model of matrix rank minimization problem proposed by Yu and Zhang (Comput.Optim.Appl. 1-20, 2022). Motivated by the inertial techinique, we propose a general inertial smoothing proximal gradient…

Optimization and Control · Mathematics 2022-04-18 Jie Zhang , Xinmin Yang

We formulate a new projection-based reduced-ordered modeling technique for non-linear dynamical systems. The proposed technique, which we refer to as the Adjoint Petrov-Galerkin (APG) method, is derived by decomposing the generalized…

Dynamical Systems · Mathematics 2019-08-30 Eric J. Parish , Christopher Wentland , Karthik Duraisamy

Wasserstein GAN(WGAN) is a model that minimizes the Wasserstein distance between a data distribution and sample distribution. Recent studies have proposed stabilizing the training process for the WGAN and implementing the Lipschitz…

Machine Learning · Computer Science 2018-10-08 Cheolhyeong Kim , Seungtae Park , Hyung Ju Hwang

The Wasserstein distance has become increasingly important in machine learning and deep learning. Despite its popularity, the Wasserstein distance is hard to approximate because of the curse of dimensionality. A recently proposed approach…

Machine Learning · Computer Science 2021-09-29 Minhui Huang , Shiqian Ma , Lifeng Lai

In this paper, we proposed an alternating projection based algorithm to solve a class of distributed MIN-MAX convex optimization problems. We firstly transform this MINMAX problem into the problem of searching for the minimum distance…

Systems and Control · Computer Science 2014-06-11 Chunhe Hu , Zongji Chen

Bayesian Optimization (BO) is widely used for optimising black-box functions but requires us to specify the length scale hyperparameter, which defines the smoothness of the functions the optimizer will consider. Most current BO algorithms…

Machine Learning · Statistics 2024-11-26 Juliusz Ziomek , Masaki Adachi , Michael A. Osborne

We propose a forward-backward splitting algorithm based on Bregman distances for composite minimization problems in general reflexive Banach spaces. The convergence is established using the notion of variable quasi-Bregman monotone…

Optimization and Control · Mathematics 2016-10-10 Quang Van Nguyen

We develop faster approximation algorithms for Metric-TSP building on recent, nearly linear time approximation schemes for the LP relaxation [Chekuri and Quanrud, 2017]. We show that the LP solution can be sparsified via cut-sparsification…

Data Structures and Algorithms · Computer Science 2018-02-06 Chandra Chekuri , Kent Quanrud

Numerous recent research on graph neural networks (GNNs) has focused on formulating GNN architectures as an optimization problem with the smoothness assumption. However, in node classification tasks, the smoothing effect induced by GNNs…

Machine Learning · Computer Science 2023-09-14 Jiayu Zhai , Lequan Lin , Dai Shi , Junbin Gao

We propose min Generalized Sliced Gromov--Wasserstein (min-GSGW), a sliced formulation for the Gromov--Wasserstein (GW) problem using expressive generalized slicers. The key idea is to learn coupled nonlinear slicers that assign compatible…

Machine Learning · Computer Science 2026-05-14 Ashkan Shahbazi , Xinran Liu , Ping He , Soheil Kolouri

This paper derives non-asymptotic error bounds for nonlinear stochastic approximation algorithms in the Wasserstein-$p$ distance. To obtain explicit finite-sample guarantees for the last iterate, we develop a coupling argument that compares…

Machine Learning · Computer Science 2026-02-03 Seo Taek Kong , R. Srikant

We develop fast approximation algorithms for the minimum-cost version of the Bounded-Degree MST problem (BD-MST) and its generalization the Crossing Spanning Tree problem (Crossing-ST). We solve the underlying LP to within a $(1+\epsilon)$…

Data Structures and Algorithms · Computer Science 2021-05-19 Chandra Chekuri , Kent Quanrud , Manuel R. Torres

We propose a novel stochastic distributed method for both monotone and strongly monotone variational inequalities with Lipschitz operator and proper convex regularizers arising in various applications from game theory to adversarial…

Optimization and Control · Mathematics 2024-10-07 Aleksandr Beznosikov , Darina Dvinskikh , Dmitry Bylinkin , Andrei Semenov , Alexander Gasnikov

In this work, we propose a novel approach for subgraph matching, the problem of finding a given query graph in a large source graph, based on the fused Gromov-Wasserstein distance. We formulate the subgraph matching problem as a partial…

Information Theory · Computer Science 2024-07-01 Wen-Xin Pan , Isabel Haasler , Pascal Frossard

This paper addresses the Graph Matching problem, which consists of finding the best possible alignment between two input graphs, and has many applications in computer vision, network deanonymization and protein alignment. A common approach…

Machine Learning · Statistics 2024-08-12 Ernesto Araya Valdivia , Hemant Tyagi

Stochastic variance reduced methods have shown strong performance in solving finite-sum problems. However, these methods usually require the users to manually tune the step-size, which is time-consuming or even infeasible for some…

Optimization and Control · Mathematics 2023-10-10 Binghui Xie , Chenhan Jin , Kaiwen Zhou , James Cheng , Wei Meng

Gaussian Belief Propagation (BP) algorithm is one of the most important distributed algorithms in signal processing and statistical learning involving Markov networks. It is well known that the algorithm correctly computes marginal density…

Machine Learning · Statistics 2019-03-08 Zhaorong Zhang , Minyue Fu

Recent studies have shown that proximal gradient (PG) method and accelerated gradient method (APG) with restarting can enjoy a linear convergence under a weaker condition than strong convexity, namely a quadratic growth condition (QGC).…

Optimization and Control · Mathematics 2017-05-16 Mingrui Liu , Tianbao Yang

We consider a distributed multi-agent optimization problem over a time-invariant undirected graph, where each agent possesses a local objective function and all agents collaboratively minimize the average of all objective functions through…

Optimization and Control · Mathematics 2019-07-19 Juan Gao , Xinwei Liu , Yu-Hong Dai , Yakui Huang , Peng Yang

In recent years, by using Bregman distance, the Lipschitz gradient continuity and strong convexity were lifted and replaced by relative smoothness and relative strong convexity. Under the mild assumptions, it was proved that gradient…

Optimization and Control · Mathematics 2022-06-22 Jian Chen , Liping Tang , Xinmin Yang