English
Related papers

Related papers: Learning Sparse Graphs via Majorization-Minimizati…

200 papers

We propose a scalable method for semi-supervised (transductive) learning from massive network-structured datasets. Our approach to semi-supervised learning is based on representing the underlying hypothesis as a graph signal with small…

Machine Learning · Computer Science 2016-11-03 Alexander Jung , Alfred O. Hero , Alexandru Mara , Sabeur Aridhi

In this paper, we propose a novel graph-based approach for semi-supervised learning problems, which considers an adaptive adjacency of the examples throughout the unsupervised portion of the training. Adjacency of the examples is inferred…

Machine Learning · Computer Science 2020-08-06 Ozsel Kilinc , Ismail Uysal

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

In a semi-supervised learning scenario, (possibly noisy) partially observed labels are used as input to train a classifier, in order to assign labels to unclassified samples. In this paper, we study this classifier learning problem from a…

Machine Learning · Computer Science 2017-07-21 Gene Cheung , Weng-Tai Su , Yu Mao , Chia-Wen Lin

Graph summarization via node grouping is a popular method to build concise graph representations by grouping nodes from the original graph into supernodes and encoding edges into superedges such that the loss of adjacency information is…

Social and Information Networks · Computer Science 2022-11-09 Arpit Merchant , Michael Mathioudakis , Yanhao Wang

Massive sizes of real-world graphs, such as social networks and web graph, impose serious challenges to process and perform analytics on them. These issues can be resolved by working on a small summary of the graph instead . A summary is a…

Data Structures and Algorithms · Computer Science 2018-06-12 Maham Anwar Beg , Muhammad Ahmad , Arif Zaman , Imdadullah Khan

This work proposes a novel method for semi-supervised learning from partially labeled massive network-structured datasets, i.e., big data over networks. We model the underlying hypothesis, which relates data points to labels, as a graph…

Machine Learning · Computer Science 2017-05-16 Alexander Jung , Alfred O. Hero , Alexandru Mara , Saeed Jahromi

In this work, we propose an adaptive sparse learning algorithm that can be applied to learn the physical processes and obtain a sparse representation of the solution given a large snapshot space. Assume that there is a rich class of…

Machine Learning · Computer Science 2022-07-26 Yating Wang , Wing Tat Leung , Guang Lin

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

Node classification is an important problem in graph data management. It is commonly solved by various label propagation methods that work iteratively starting from a few labeled seed nodes. For graphs with arbitrary compatibilities between…

Machine Learning · Computer Science 2020-03-06 Krishna Kumar P. , Paul Langton , Wolfgang Gatterbauer

In graph signal processing, data samples are associated to vertices on a graph, while edge weights represent similarities between those samples. We propose a convex optimization problem to learn sparse well connected graphs from data. We…

Signal Processing · Electrical Eng. & Systems 2020-04-21 Eduardo Pavez , Antonio Ortega

Sampling of signals defined over the nodes of a graph is one of the crucial problems in graph signal processing. While in classical signal processing sampling is a well defined operation, when we consider a graph signal many new challenges…

Information Theory · Computer Science 2019-05-30 Diego Valsesia , Giulia Fracastoro , Enrico Magli

Large data applications rely on storing data in massive, sparse graphs with millions to trillions of nodes. Graph-based methods, such as node prediction, aim for computational efficiency regardless of graph size. Techniques like localized…

Data Structures and Algorithms · Computer Science 2025-07-08 Yushen Huang , Ertai Luo , Reza Babenezhad , Yifan Sun

In the undersampled phase retrieval problem, the goal is to recover an $N$-dimensional complex signal $\mathbf{x}$ from only $M<N$ noisy intensity measurements without phase information. This problem has drawn a lot of attention to reduce…

Information Theory · Computer Science 2017-10-11 Tianyu Qiu , Daniel P. Palomar

This paper studies graph-based active learning, where the goal is to reconstruct a binary signal defined on the nodes of a weighted graph, by sampling it on a small subset of the nodes. A new sampling algorithm is proposed, which…

Machine Learning · Computer Science 2016-05-19 Eyal En Gad , Akshay Gadde , A. Salman Avestimehr , Antonio Ortega

Graph embedding learns low-dimensional representations for nodes in a graph and effectively preserves the graph structure. Recently, a significant amount of progress has been made toward this emerging research area. However, there are…

Machine Learning · Computer Science 2019-05-20 Yuan Yin , Zhewei Wei

We introduce Tiered Sampling, a novel technique for approximate counting sparse motifs in massive graphs whose edges are observed in a stream. Our technique requires only a single pass on the data and uses a memory of fixed size $M$, which…

Data Structures and Algorithms · Computer Science 2017-10-06 Lorenzo De Stefani , Erisa Terolli , Eli Upfal

Recovering sparse conditional independence graphs from data is a fundamental problem in machine learning with wide applications. A popular formulation of the problem is an $\ell_1$ regularized maximum likelihood estimation. Many convex…

Machine Learning · Computer Science 2019-12-24 Harsh Shrivastava , Xinshi Chen , Binghong Chen , Guanghui Lan , Srinvas Aluru , Han Liu , Le Song

Sharpness-aware minimization (SAM) has emerged as a highly effective technique to improve model generalization, but its underlying principles are not fully understood. We investigate m-sharpness, where SAM performance improves monotonically…

Machine Learning · Computer Science 2026-04-03 Haocheng Luo , Mehrtash Harandi , Dinh Phung , Trung Le

Sampling methods (e.g., node-wise, layer-wise, or subgraph) has become an indispensable strategy to speed up training large-scale Graph Neural Networks (GNNs). However, existing sampling methods are mostly based on the graph structural…

Machine Learning · Computer Science 2021-09-07 Weilin Cong , Rana Forsati , Mahmut Kandemir , Mehrdad Mahdavi