English
Related papers

Related papers: Compressing regularized dynamics improves link pre…

200 papers

Given a limited number of entries from the superposition of a low-rank matrix plus the product of a known fat compression matrix times a sparse matrix, recovery of the low-rank and sparse components is a fundamental task subsuming…

Multiagent Systems · Computer Science 2013-10-01 Morteza Mardani , Gonzalo Mateos , Georgios B. Giannakis

Deep Neural Networks have achieved remarkable success relying on the developing availability of GPUs and large-scale datasets with increasing network depth and width. However, due to the expensive computation and intensive memory,…

Machine Learning · Computer Science 2020-09-07 E Zhenqian , Gao Weiguo

Parameter-space regularization in neural network optimization is a fundamental tool for improving generalization. However, standard parameter-space regularization methods make it challenging to encode explicit preferences about desired…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Sanyam Kapoor , Shikai Qiu , Andrew Gordon Wilson

In our recent works, we developed a probabilistic framework for structural analysis in undirected networks. The key idea of that framework is to sample a network by a symmetric bivariate distribution and then use that bivariate distribution…

Social and Information Networks · Computer Science 2015-10-19 Cheng-Shang Chang , Duan-Shin Lee , Li-Heng Liou , Sheng-Min Lu , Mu-Huan Wu

Although many successful ensemble clustering approaches have been developed in recent years, there are still two limitations to most of the existing approaches. First, they mostly overlook the issue of uncertain links, which may mislead the…

Machine Learning · Statistics 2016-06-06 Dong Huang , Jian-Huang Lai , Chang-Dong Wang

Multilayer graphs are appealing mathematical tools for modeling multiple types of relationship in the data. In this paper, we aim at analyzing multilayer graphs by properly combining the information provided by individual layers, while…

Machine Learning · Computer Science 2020-10-30 Mireille El Gheche , Pascal Frossard

The study of dynamical systems on networks, describing complex interactive processes, provides insight into how network structure affects global behaviour. Yet many methods for network dynamics fail to cope with large or partially-known…

Physics and Society · Physics 2018-09-05 Neave O'Clery , Ye Yuan , Guy-Bart Stan , Mauricio Barahona

Detecting significant community structure in networks with incomplete observations is challenging because the evidence for specific solutions fades away with missing data. For example, recent research shows that flow-based community…

Social and Information Networks · Computer Science 2021-12-14 Jelena Smiljanić , Christopher Blöcker , Daniel Edler , Martin Rosvall

We are interested in multilayer graph clustering, which aims at dividing the graph nodes into categories or communities. To do so, we propose to learn a clustering-friendly embedding of the graph nodes by solving an optimization problem…

Machine Learning · Computer Science 2021-03-31 Mireille El Gheche , Pascal Frossard

We study random graphs with possibly different edge probabilities in the challenging sparse regime of bounded expected degrees. Unlike in the dense case, neither the graph adjacency matrix nor its Laplacian concentrate around their…

Statistics Theory · Mathematics 2015-04-24 Can M. Le , Elizaveta Levina , Roman Vershynin

Modern technologies are producing a wealth of data with complex structures. For instance, in two-dimensional digital imaging, flow cytometry, and electroencephalography, matrix type covariates frequently arise when measurements are obtained…

Methodology · Statistics 2013-10-22 Hua Zhou , Lexin Li

Community structure in networks is observed in many different domains, and unsupervised community detection has received a lot of attention in the literature. Increasingly the focus of network analysis is shifting towards using network…

Methodology · Statistics 2020-03-02 Jesús Arroyo , Elizaveta Levina

This article considers spectral community detection in the regime of sparse networks with heterogeneous degree distributions, for which we devise an algorithm to efficiently retrieve communities. Specifically, we demonstrate that a…

Machine Learning · Statistics 2021-10-12 Lorenzo Dall'Amico , Romain Couillet , Nicolas Tremblay

We introduce a novel stochastic regularization technique for deep neural networks, which decomposes a layer into multiple branches with different parameters and merges stochastically sampled combinations of the outputs from the branches…

Machine Learning · Computer Science 2019-10-04 Wonpyo Park , Paul Hongsuck Seo , Bohyung Han , Minsu Cho

A regularized version of Mixture Models is proposed to learn a principal graph from a distribution of $D$-dimensional data points. In the particular case of manifold learning for ridge detection, we assume that the underlying manifold can…

Machine Learning · Computer Science 2023-07-13 Tony Bonnaire , Aurélien Decelle , Nabila Aghanim

Predicting the occurrence of links is a fundamental problem in networks. In the link prediction problem we are given a snapshot of a network and would like to infer which interactions among existing members are likely to occur in the near…

Social and Information Networks · Computer Science 2010-11-19 L. Backstrom , J. Leskovec

We consider adaptive system identification problems with convex constraints and propose a family of regularized Least-Mean-Square (LMS) algorithms. We show that with a properly selected regularization parameter the regularized LMS provably…

Methodology · Statistics 2010-12-24 Yilun Chen , Yuantao Gu , Alfred O. Hero

Random matrix theory has played an important role in recent work on statistical network analysis. In this paper, we review recent results on regimes of concentration of random graphs around their expectation, showing that dense graphs…

Statistics Theory · Mathematics 2018-01-29 Can M. Le , Elizaveta Levina , Roman Vershynin

Neural networks are powerful function approximators with tremendous potential in learning complex distributions. However, they are prone to overfitting on spurious patterns. Bayesian inference provides a principled way to regularize neural…

Machine Learning · Computer Science 2024-12-02 Yanzhe Bekkemoen , Helge Langseth

Community detection is one of the most important problems in network analysis. Among many algorithms proposed for this task, methods based on statistical inference are of particular interest: they are mathematically sound and were shown to…

Social and Information Networks · Computer Science 2019-02-25 Liudmila Prokhorenkova , Alexey Tikhonov