English
Related papers

Related papers: Uniform Convergence Rates for Lipschitz Learning o…

200 papers

We study the game theoretic p-Laplacian for semi-supervised learning on graphs, and show that it is well-posed in the limit of finite labeled data and infinite unlabeled data. In particular, we show that the continuum limit of graph-based…

Analysis of PDEs · Mathematics 2018-08-28 Jeff Calder

Graph Semi-Supervised learning is an important data analysis tool, where given a graph and a set of labeled nodes, the aim is to infer the labels to the remaining unlabeled nodes. In this paper, we start by considering an optimization-based…

Machine Learning · Computer Science 2023-09-26 Sara Venturini , Andrea Cristofari , Francesco Rinaldi , Francesco Tudisco

The convergence theory for the gradient sampling algorithm is extended to directionally Lipschitz functions. Although directionally Lipschitz functions are not necessarily locally Lipschitz, they are almost everywhere differentiable and…

Optimization and Control · Mathematics 2021-07-13 James V. Burke , Qiuying Lin

We consider the Dirichlet problem for elliptic systems with periodically distributed inclusions whose conduction parameter exhibits a significant contrast compared to the background media. We develop a unified method to quantify the…

Analysis of PDEs · Mathematics 2024-04-18 Xin Fu , Wenjia Jing

We analyze the universality and generalization of graph neural networks (GNNs) on attributed graphs, i.e., with node attributes. To this end, we propose pseudometrics over the space of all attributed graphs that describe the fine-grained…

Machine Learning · Computer Science 2025-08-27 Levi Rauchwerger , Stefanie Jegelka , Ron Levie

Motivated by the need to address the degeneracy of canonical Laplace learning algorithms in low label rates, we propose to reformulate graph-based semi-supervised learning as a nonconvex generalization of a \emph{Trust-Region Subproblem}…

Machine Learning · Computer Science 2024-08-15 Chester Holtz , Pengwen Chen , Alexander Cloninger , Chung-Kuan Cheng , Gal Mishne

Graph Neural Networks have shown excellent performance on semi-supervised classification tasks. However, they assume access to a graph that may not be often available in practice. In the absence of any graph, constructing k-Nearest Neighbor…

Machine Learning · Computer Science 2021-02-23 Vijay Lingam , Arun Iyer , Rahul Ragesh

We investigate a family of regression problems in a semi-supervised setting. The task is to assign real-valued labels to a set of $n$ sample points, provided a small training subset of $N$ labeled points. A goal of semi-supervised learning…

Statistics Theory · Mathematics 2017-10-17 Dejan Slepčev , Matthew Thorpe

This paper proposes a novel algorithm for semisupervised learning. This algorithm learns graph cuts that maximize the margin with respect to the labels induced by the harmonic function solution. We motivate the approach, compare it to…

Machine Learning · Computer Science 2026-04-30 Branislav Kveton , Michal Valko , Ali Rahimi , Ling Huang

Computational efficiency is a major bottleneck in using classic graph-based approaches for semi-supervised learning on datasets with a large number of unlabeled examples. Known techniques to improve efficiency typically involve an…

Machine Learning · Computer Science 2023-06-13 Dravyansh Sharma , Maxwell Jones

Semi-supervised learning has received attention from researchers, as it allows one to exploit the structure of unlabeled data to achieve competitive classification results with much fewer labels than supervised approaches. The Local and…

Machine Learning · Computer Science 2022-01-11 Bruno Klaus de Aquino Afonso , Lilian Berton

Graphs are fundamental tools for modeling pairwise interactions in complex systems. However, many real-world systems involve multi-way interactions that cannot be fully captured by standard graphs. Hypergraphs, which generalize graphs by…

Metric Geometry · Mathematics 2024-12-04 Tom Needham , Ethan Semrad

$M$-Lipschitz mappings of graphs (or equivalently graph-indexed random walks) are a generalization of standard random walk on $\mathbb{Z}$. For $M \in \N$, an \emph{$M$-Lipschitz mapping} of a connected rooted graph $G = (V,E)$ is a mapping…

Combinatorics · Mathematics 2018-04-26 Jan Bok

Recently there were proposed some innovative convex optimization concepts, namely, relative smoothness [1] and relative strong convexity [2,3]. These approaches have significantly expanded the class of applicability of gradient-type methods…

Optimization and Control · Mathematics 2024-04-19 Fedor Stonyakin , Alexander Titov , Mohammad Alkousa , Oleg Savchuk , Alexander Gasnikov

In this paper, we propose the Lipschitz margin ratio and a new metric learning framework for classification through maximizing the ratio. This framework enables the integration of both the inter-class margin and the intra-class dispersion,…

Machine Learning · Computer Science 2018-02-13 Mingzhi Dong , Xiaochen Yang , Yang Wu , Jing-Hao Xue

Graph-based semi-supervised learning is the problem of propagating labels from a small number of labelled data points to a larger set of unlabelled data. This paper is concerned with the consistency of optimization-based techniques for such…

Machine Learning · Statistics 2020-03-11 Franca Hoffmann , Bamdad Hosseini , Zhi Ren , Andrew M. Stuart

Graph-based semi-supervised learning usually involves two separate stages, constructing an affinity graph and then propagating labels for transductive inference on the graph. It is suboptimal to solve them independently, as the correlation…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Qilin Li , Senjian An , Ling Li , Wanquan Liu

Deep learning has non-convex loss landscape and its optimization dynamics is hard to analyze or control. Nevertheless, the dynamics can be empirically convex-like across various tasks, models, optimizers, hyperparameters, etc. In this work,…

Machine Learning · Computer Science 2026-02-10 Zhiqi Bu , Shiyun Xu , Jialin Mao

In the literature, most existing graph-based semi-supervised learning (SSL) methods only use the label information of observed samples in the label propagation stage, while ignoring such valuable information when learning the graph. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Liansheng Zhuang , Zihan Zhou , Jingwen Yin , Shenghua Gao , Zhouchen Lin , Yi Ma , Nenghai Yu

Decentralized optimization has become a fundamental tool for large-scale learning systems; however, most existing methods rely on the classical Lipschitz smoothness assumption, which is often violated in problems with rapidly varying…

Optimization and Control · Mathematics 2026-01-08 Yanan Bo , Yongqiang Wang