English
Related papers

Related papers: Uniform Convergence Rates for Lipschitz Learning o…

200 papers

We present a semi-supervised learning framework based on graph embeddings. Given a graph between instances, we train an embedding for each instance to jointly predict the class label and the neighborhood context in the graph. We develop…

Machine Learning · Computer Science 2016-05-30 Zhilin Yang , William W. Cohen , Ruslan Salakhutdinov

Semi-supervised learning provides an effective paradigm for leveraging unlabeled data to improve a model's performance. Among the many strategies proposed, graph-based methods have shown excellent properties, in particular since they allow…

Machine Learning · Statistics 2021-03-29 Mourad El Hamri , Younès Bennani

We study a class of semilinear diffusion equations on infinite, connected, weighted graphs, focusing on two types of nonlinearities: monotone decreasing and Lipschitz continuous. Under minimal structural assumptions on the graph, we…

Analysis of PDEs · Mathematics 2026-05-15 Elvise Berchio , Davide Bianchi , Alberto G. Setti , Maria Vallarino

Lipschitz continuity is a crucial functional property of any predictive model, that naturally governs its robustness, generalisation, as well as adversarial vulnerability. Contrary to other works that focus on obtaining tighter bounds and…

Machine Learning · Computer Science 2024-05-16 Grigory Khromov , Sidak Pal Singh

Smoothness and low dimensional structures play central roles in improving generalization and stability in learning and statistics. This work combines techniques from semi-infinite constrained learning and manifold regularization to learn…

Machine Learning · Computer Science 2023-02-03 Juan Cervino , Luiz F. O. Chamon , Benjamin D. Haeffele , Rene Vidal , Alejandro Ribeiro

The manifold hypothesis posits that high-dimensional data typically resides on low-dimensional sub spaces. In this paper, we assume manifold hypothesis to investigate graph-based semi-supervised learning methods. In particular, we examine…

Machine Learning · Computer Science 2025-11-18 Mary Chriselda Antony Oliver , Michael Roberts , Carola-Bibiane Schönlieb , Matthew Thorpe

Lipschitz Bound Estimation is an effective method of regularizing deep neural networks to make them robust against adversarial attacks. This is useful in a variety of applications ranging from reinforcement learning to autonomous systems.…

Machine Learning · Computer Science 2022-07-18 Sarosij Bose

We introduce a novel framework, called Interface Laplace learning, for graph-based semi-supervised learning. Motivated by the observation that an interface should exist between different classes where the function value is non-smooth, we…

Machine Learning · Computer Science 2025-07-08 Tangjun Wang , Chenglong Bao , Zuoqiang Shi

We consider a family of problems that are concerned about making predictions for the majority of unlabeled, graph-structured data samples based on a small proportion of labeled samples. Relational information among the data samples, often…

Machine Learning · Computer Science 2019-11-05 Jiaqi Ma , Weijing Tang , Ji Zhu , Qiaozhu Mei

In this paper, we deal with a notion of Banach space-valued mappings defined on a set consisting of finite graphs with uniformly bounded vertex degree. These functions will be endowed with certain boundedness and additivity criteria. We…

Combinatorics · Mathematics 2015-01-14 Felix Pogorzelski

Graph neural networks (GNNs) achieve remarkable success in graph-based semi-supervised node classification, leveraging the information from neighboring nodes to improve the representation learning of target node. The success of GNNs at node…

Machine Learning · Computer Science 2020-07-28 Bingbing Xu , Junjie Huang , Liang Hou , Huawei Shen , Jinhua Gao , Xueqi Cheng

We consider weighted graphs with an infinite set of vertices. We show that boundedness of all functions of finite energy can be seen as a notion of `relative compactness' for such graphs and study sufficient and necessary conditions for…

Hypergraphs are a common model for multiway relationships in data, and hypergraph semi-supervised learning is the problem of assigning labels to all nodes in a hypergraph, given labels on just a few nodes. Diffusions and label spreading are…

Machine Learning · Computer Science 2022-02-14 Francesco Tudisco , Konstantin Prokopchik , Austin R. Benson

This work proposes a novel method for semi-supervised learning from partially labeled massive network-structured datasets, i.e., big data over networks. We model the underlying hypothesis, which relates data points to labels, as a graph…

Machine Learning · Computer Science 2017-05-16 Alexander Jung , Alfred O. Hero , Alexandru Mara , Saeed Jahromi

We investigate the convergence rate of the recently proposed subgradient-push method for distributed optimization over time-varying directed graphs. The subgradient-push method can be implemented in a distributed way without requiring…

Optimization and Control · Mathematics 2015-02-17 Angelia Nedic , Alex Olshevsky

Main results of the paper: (1) For any finite metric space $M$ the Lipschitz free space on $M$ contains a large well-complemented subspace which is close to $\ell_1^n$. (2) Lipschitz free spaces on large classes of recursively defined…

Functional Analysis · Mathematics 2018-07-12 Stephen J. Dilworth , Denka Kutzarova , Mikhail I. Ostrovskii

We consider a novel data driven approach for designing learning algorithms that can effectively learn with only a small number of labeled examples. This is crucial for modern machine learning applications where labels are scarce or…

Machine Learning · Computer Science 2021-10-01 Maria-Florina Balcan , Dravyansh Sharma

Optimizing deep neural networks is largely thought to be an empirical process, requiring manual tuning of several hyper-parameters, such as learning rate, weight decay, and dropout rate. Arguably, the learning rate is the most important of…

Machine Learning · Computer Science 2020-08-04 Rahul Yedida , Snehanshu Saha , Tejas Prashanth

We propose a new length formula that governs the iterates of the momentum method when minimizing differentiable semialgebraic functions with locally Lipschitz gradients. It enables us to establish local convergence, global convergence, and…

Optimization and Control · Mathematics 2024-01-09 Cédric Josz , Lexiao Lai , Xiaopeng Li

We establish generic uniform convergence guarantees for Gaussian data in terms of the Rademacher complexity of the hypothesis class and the Lipschitz constant of the square root of the scalar loss function. We show how these guarantees…

Machine Learning · Statistics 2023-06-26 Lijia Zhou , Zhen Dai , Frederic Koehler , Nathan Srebro