English
Related papers

Related papers: Learning Sparse Graphs via Majorization-Minimizati…

200 papers

Graph Neural Networks have shown excellent performance on semi-supervised classification tasks. However, they assume access to a graph that may not be often available in practice. In the absence of any graph, constructing k-Nearest Neighbor…

Machine Learning · Computer Science 2021-02-23 Vijay Lingam , Arun Iyer , Rahul Ragesh

Sparse recovery can recover sparse signals from a set of underdetermined linear measurements. Motivated by the need to monitor large-scale networks from a limited number of measurements, this paper addresses the problem of recovering sparse…

Information Theory · Computer Science 2015-03-20 Meng Wang , Weiyu Xu , Enrique Mallada , Ao Tang

Learning a smooth graph signal from partially observed data is a well-studied task in graph-based machine learning. We consider this task from the perspective of optimal recovery, a mathematical framework for learning a function from…

Machine Learning · Computer Science 2023-05-31 Simon Foucart , Chunyang Liao , Nate Veldt

In an era of unprecedented deluge of (mostly unstructured) data, graphs are proving more and more useful, across the sciences, as a flexible abstraction to capture complex relationships between complex objects. One of the main challenges…

Disordered Systems and Neural Networks · Physics 2016-10-17 Alaa Saade

We propose and analyze a novel framework for learning sparse representations, based on two statistical techniques: kernel smoothing and marginal regression. The proposed approach provides a flexible framework for incorporating feature…

Machine Learning · Statistics 2012-10-04 Krishnakumar Balasubramanian , Kai Yu , Guy Lebanon

In practical machine learning systems, graph based data representation has been widely used in various learning paradigms, ranging from unsupervised clustering to supervised classification. Besides those applications with natural graph or…

Machine Learning · Computer Science 2012-10-19 Jun Wang , Yinglong Xia

We propose a new majorization-minimization (MM) method for non-smooth and non-convex programs, which is general enough to include the existing MM methods. Besides the local majorization condition, we only require that the difference between…

Optimization and Control · Mathematics 2015-11-26 Chen Xu , Zhouchen Lin , Zhenyu Zhao , Hongbin Zha

We propose a denoising method for multimodal graph signals by an alternating minimization scheme that sequentially solves signal restoration and graph learning problems. Many complex-structured data, i.e., those on sensor networks, can…

Signal Processing · Electrical Eng. & Systems 2026-04-23 Hayate Kojima , Keigo Takanami , Junya Hara , Yukihiro Bandoh , Seishi Takamura , Hiroshi Higashi , Yuichi Tanaka

We propose a novel framework for learning time-varying graphs from spatiotemporal measurements. Given an appropriate prior on the temporal behavior of signals, our proposed method can estimate time-varying graphs from a small number of…

Signal Processing · Electrical Eng. & Systems 2025-09-10 Haruki Yokota , Koki Yamada , Yuichi Tanaka , Antonio Ortega

Large-scale network embedding is to learn a latent representation for each node in an unsupervised manner, which captures inherent properties and structural information of the underlying graph. In this field, many popular approaches are…

Machine Learning · Computer Science 2020-12-11 Shengzhong Zhang , Zengfeng Huang , Haicang Zhou , Ziang Zhou

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

We study the node classification problem on feature-decorated graphs in the sparse setting, i.e., when the expected degree of a node is $O(1)$ in the number of nodes, in the fixed-dimensional asymptotic regime, i.e., the dimension of the…

Machine Learning · Computer Science 2025-01-10 Aseem Baranwal , Kimon Fountoulakis , Aukosh Jagannath

Scalability of graph neural networks remains one of the major challenges in graph machine learning. Since the representation of a node is computed by recursively aggregating and transforming representation vectors of its neighboring nodes…

Machine Learning · Computer Science 2021-06-10 Zengfeng Huang , Shengzhong Zhang , Chong Xi , Tang Liu , Min Zhou

The Laplacian-constrained Gaussian Markov Random Field (LGMRF) is a common multivariate statistical model for learning a weighted sparse dependency graph from given data. This graph learning problem can be formulated as a maximum likelihood…

Machine Learning · Computer Science 2024-04-15 Yakov Medvedovsky , Eran Treister , Tirza Routtenberg

Real-world graphs can be difficult to interpret and visualize beyond a certain size. To address this issue, graph summarization aims to simplify and shrink a graph, while maintaining its high-level structure and characteristics. Most…

Social and Information Networks · Computer Science 2022-06-16 Dimitris Berberidis , Pierre J. Liang , Leman Akoglu

Signed graphs, which are characterized by both positive and negative edge weights, have recently attracted significant attention in the field of graph signal processing (GSP). Existing works on signed graph learning typically assume that…

Signal Processing · Electrical Eng. & Systems 2025-09-12 Rong Ye , Xue-Qin Jiang , Hui Feng , Jian Wang , Runhe Qiu

This work aims at improving the energy efficiency of decentralized learning by optimizing the mixing matrix, which controls the communication demands during the learning process. Through rigorous analysis based on a state-of-the-art…

Machine Learning · Computer Science 2024-05-24 Xusheng Zhang , Cho-Chun Chiu , Ting He

In this paper, we consider high-dimensional nonconvex square-root-loss regression problems and introduce a proximal majorization-minimization (PMM) algorithm for these problems. Our key idea for making the proposed PMM to be efficient is to…

Optimization and Control · Mathematics 2020-05-28 Peipei Tang , Chengjing Wang , Defeng Sun , Kim-Chuan Toh

In this paper, we focus on learning sparse graphs with a core-periphery structure. We propose a generative model for data associated with core-periphery structured networks to model the dependence of node attributes on core scores of the…

Machine Learning · Computer Science 2021-10-11 Sravanthi Gurugubelli , Sundeep Prabhakar Chepuri

We propose a novel algorithm for efficiently computing a sparse directed adjacency matrix from a group of time series following a causal graph process. Our solution is scalable for both dense and sparse graphs and automatically selects the…

Machine Learning · Statistics 2019-11-19 Théophile Griveau-Billion , Ben Calderhead