English
Related papers

Related papers: Uniform Convergence Rates for Lipschitz Learning o…

200 papers

Semi-supervised learning and continuous learning are fundamental paradigms for human-level intelligence. To deal with real-world problems where labels are rarely given and the opportunity to access the same data is limited, it is necessary…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Taehyeong Kim , Injune Hwang , Gi-Cheon Kang , Won-Seok Choi , Hyunseo Kim , Byoung-Tak Zhang

We propose a consistent polynomial-time method for the unseeded node matching problem for networks with smooth underlying structures. Despite widely conjectured by the research community that the structured graph matching problem to be…

Machine Learning · Statistics 2018-08-24 Yuan Zhang

Given a sample from a probability measure with support on a submanifold in Euclidean space one can construct a neighborhood graph which can be seen as an approximation of the submanifold. The graph Laplacian of such a graph is used in…

Statistics Theory · Mathematics 2007-06-27 Matthias Hein , Jean-Yves Audibert , Ulrike von Luxburg

Evolution strategy (ES) is one of the promising classes of algorithms for black-box continuous optimization. Despite its broad successes in applications, theoretical analysis on the speed of its convergence is limited on convex quadratic…

Optimization and Control · Mathematics 2025-09-03 Daiki Morinaga , Kazuto Fukuchi , Jun Sakuma , Youhei Akimoto

We consider deep neural networks with a Lipschitz continuous activation function and with weight matrices of variable widths. We establish a uniform convergence analysis framework in which sufficient conditions on weight matrices and bias…

Machine Learning · Computer Science 2023-06-05 Yuesheng Xu , Haizhang Zhang

Multi-view learning has progressed rapidly in recent years. Although many previous studies assume that each instance appears in all views, it is common in real-world applications for instances to be missing from some views, resulting in…

Machine Learning · Computer Science 2022-08-30 Pengfei Zhu , Xinjie Yao , Yu Wang , Meng Cao , Binyuan Hui , Shuai Zhao , Qinghua Hu

Recent semi-supervised learning methods have shown to achieve comparable results to their supervised counterparts while using only a small portion of labels in image classification tasks thanks to their regularization strategies. In this…

Machine Learning · Computer Science 2020-09-25 Wei-Hong Li , Chuan-Sheng Foo , Hakan Bilen

Semi-supervised and unsupervised machine learning methods often rely on graphs to model data, prompting research on how theoretical properties of operators on graphs are leveraged in learning problems. While most of the existing literature…

Analysis of PDEs · Mathematics 2021-01-12 Amber Yuan , Jeff Calder , Braxton Osting

We describe algorithms for finding the regression of t, a sequence of values, to the closest sequence s by mean squared error, so that s is always increasing (isotonicity) and so the values of two consecutive points do not increase by too…

Data Structures and Algorithms · Computer Science 2009-12-31 Pankaj K. Agarwal , Jeff M. Phillips , Bardia Sadri

We analyze recurrent neural networks with diagonal hidden-to-hidden weight matrices, trained with gradient descent in the supervised learning setting, and prove that gradient descent can achieve optimality \emph{without} massive…

Machine Learning · Computer Science 2024-10-11 Semih Cayci , Atilla Eryilmaz

Label propagation is a powerful and flexible semi-supervised learning technique on graphs. Neural networks, on the other hand, have proven track records in many supervised learning tasks. In this work, we propose a training framework with a…

Machine Learning · Computer Science 2017-03-16 Thang D. Bui , Sujith Ravi , Vivek Ramavajjala

This paper investigates the use of methods from partial differential equations and the Calculus of variations to study learning problems that are regularized using graph Laplacians. Graph Laplacians are a powerful, flexible method for…

Machine Learning · Statistics 2020-06-30 Nicolas Garcia Trillos , Ryan Murray

As a fundamental problem in pattern recognition, graph matching has applications in a variety of fields, from computer vision to computational biology. In graph matching, patterns are modeled as graphs and pattern recognition amounts to…

Computer Vision and Pattern Recognition · Computer Science 2008-06-19 Tiberio S. Caetano , Julian J. McAuley , Li Cheng , Quoc V. Le , Alex J. Smola

We consider the problem of offline, pool-based active semi-supervised learning on graphs. This problem is important when the labeled data is scarce and expensive whereas unlabeled data is easily available. The data points are represented by…

Machine Learning · Computer Science 2014-05-20 Akshay Gadde , Aamir Anis , Antonio Ortega

Graph learning is a popular approach for performing machine learning on graph-structured data. It has revolutionized the machine learning ability to model graph data to address downstream tasks. Its application is wide due to the…

Machine Learning · Computer Science 2022-11-07 Falih Gozi Febrinanto , Feng Xia , Kristen Moore , Chandra Thapa , Charu Aggarwal

Classical results show that gradient descent converges linearly to minimizers of smooth strongly convex functions. A natural question is whether there exists a locally nearly linearly convergent method for nonsmooth functions with quadratic…

Optimization and Control · Mathematics 2023-07-18 Damek Davis , Liwei Jiang

Extremal graph theory studies the maximum or minimum number of subgraphs isomorphic to a prescribed graph under given constraints. \textit{Localization} has recently emerged as a framework that refines such problems by assigning extremal…

Combinatorics · Mathematics 2026-03-10 Rajat Adak , L. Sunil Chandran

Many physical systems -- such as optical waveguide lattices and dense neuronal or vascular networks -- can be modeled by metric graphs, where slender "wires" (edges) support wave or diffusion equations subject to Kirchhoff conditions at the…

Mathematical Physics · Physics 2025-08-26 Sidney Holden , Geoffrey Vasil

We consider the general problem of utilizing both labeled and unlabeled data to improve data representation performance. A new semi-supervised learning framework is proposed by combing manifold regularization and data representation methods…

Machine Learning · Computer Science 2015-02-16 Weiya Ren

We consider large random graphs with prescribed degrees, such as those generated by the configuration model. In the regime where the empirical degree distribution approaches a limit $\mu$ with finite mean, we establish the systematic…

Probability · Mathematics 2019-02-20 Justin Salez