English
Related papers

Related papers: Uniform Convergence Rates for Lipschitz Learning o…

200 papers

We investigate the effect of explicitly enforcing the Lipschitz continuity of neural networks with respect to their inputs. To this end, we provide a simple technique for computing an upper bound to the Lipschitz constant---for multiple…

Machine Learning · Statistics 2020-08-11 Henry Gouk , Eibe Frank , Bernhard Pfahringer , Michael J. Cree

Graph-based methods have been demonstrated as one of the most effective approaches for semi-supervised learning, as they can exploit the connectivity patterns between labeled and unlabeled data samples to improve learning performance.…

Machine Learning · Computer Science 2019-07-01 Qimai Li , Xiao-Ming Wu , Han Liu , Xiaotong Zhang , Zhichao Guan

We investigate the stochastic optimization problem of minimizing population risk, where the loss defining the risk is assumed to be weakly convex. Compositions of Lipschitz convex functions with smooth maps are the primary examples of such…

Optimization and Control · Mathematics 2018-12-19 Damek Davis , Dmitriy Drusvyatskiy

The notions of bounded expansion and nowhere denseness not only offer robust and general definitions of uniform sparseness of graphs, they also describe the tractability boundary for several important algorithmic questions. In this paper we…

Discrete Mathematics · Computer Science 2019-09-25 Wojciech Nadara , Marcin Pilipczuk , Roman Rabinovich , Felix Reidl , Sebastian Siebertz

Graphs have become increasingly popular in modeling structures and interactions in a wide variety of problems during the last decade. Graph-based clustering and semi-supervised classification techniques have shown impressive performance.…

Machine Learning · Computer Science 2020-09-01 Zhao Kang , Chong Peng , Qiang Cheng , Xinwang Liu , Xi Peng , Zenglin Xu , Ling Tian

We propose a new framework, called Poisson learning, for graph based semi-supervised learning at very low label rates. Poisson learning is motivated by the need to address the degeneracy of Laplacian semi-supervised learning in this regime.…

Machine Learning · Computer Science 2020-08-17 Jeff Calder , Brendan Cook , Matthew Thorpe , Dejan Slepcev

Previous hypergraph expansions are solely carried out on either vertex level or hyperedge level, thereby missing the symmetric nature of data co-occurrence, and resulting in information loss. To address the problem, this paper treats…

Machine Learning · Computer Science 2023-04-14 Chaoqi Yang , Ruijie Wang , Shuochao Yao , Tarek Abdelzaher

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

For challenging machine learning problems such as zero-shot learning and fine-grained categorization, embedding learning is the machinery of choice because of its ability to learn generic notions of similarity, as opposed to class-specific…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Ujjal Kr Dutta , Mehrtash Harandi , Chandra Sekhar Chellu

Lipschitz extensions were recently proposed as a tool for designing node differentially private algorithms. However, efficiently computable Lipschitz extensions were known only for 1-dimensional functions (that is, functions that output a…

Cryptography and Security · Computer Science 2015-04-30 Sofya Raskhodnikova , Adam Smith

Operator learning, the approximation of mappings between infinite-dimensional function spaces using machine learning, has gained increasing research attention in recent years. Approximate operators, learned from data, can serve as efficient…

Machine Learning · Computer Science 2025-06-27 Ben Adcock , Michael Griebel , Gregor Maier

We propose a supervised learning approach for predicting an underlying graph from a set of graph signals. Our approach is based on linear regression. In the linear regression model, we predict edge-weights of a graph as the output, given a…

Information Theory · Computer Science 2018-11-06 Arun Venkitaraman , Hermina Petric Maretic , Saikat Chatterjee , Pascal Frossard

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

Machine Learning · Computer Science 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang

We study problem-dependent rates, i.e., generalization errors that scale near-optimally with the variance, the effective loss, or the gradient norms evaluated at the "best hypothesis." We introduce a principled framework dubbed "uniform…

Machine Learning · Statistics 2020-12-25 Yunbei Xu , Assaf Zeevi

This paper demonstrates the robustness of Lipschitz-regularized $\alpha$-divergences as objective functionals in generative modeling, showing they enable stable learning across a wide range of target distributions with minimal assumptions.…

Machine Learning · Statistics 2025-09-09 Ziyu Chen , Hyemin Gu , Markos A. Katsoulakis , Luc Rey-Bellet , Wei Zhu

This paper examines the asymptotic convergence properties of Lipschitz interpolation methods within the context of bounded stochastic noise. In the first part of the paper, we establish probabilistic consistency guarantees of the classical…

Optimization and Control · Mathematics 2023-10-12 Julien Walden Huang , Stephen Roberts , Jan-Peter Calliess

Graph representation learning has attracted lots of attention recently. Existing graph neural networks fed with the complete graph data are not scalable due to limited computation and memory costs. Thus, it remains a great challenge to…

Machine Learning · Computer Science 2020-11-24 Yizhu Jiao , Yun Xiong , Jiawei Zhang , Yao Zhang , Tianqi Zhang , Yangyong Zhu

Semi-supervised learning on graphs is a widely applicable problem in network science and machine learning. Two standard algorithms -- label propagation and graph neural networks -- both operate by repeatedly passing information along edges,…

Machine Learning · Computer Science 2021-02-02 Junteng Jia , Austin R. Benson

We propose a monotone, and consistent numerical scheme for the approximation of the Dirichlet problem for the normalized Infinity Laplacian, which could be related to the family of so--called two--scale methods. We show that this method is…

Numerical Analysis · Mathematics 2022-09-14 Wenbo Li , Abner J. Salgado

Let $G=(V,E)$ be a finite, connected graph. We consider a greedy selection of vertices: given a list of vertices $x_1, \dots, x_k$, take $x_{k+1}$ to be any vertex maximizing the sum of distances to the existing vertices and iterate: we…

Combinatorics · Mathematics 2022-05-06 Stefan Steinerberger
‹ Prev 1 3 4 5 6 7 10 Next ›