English
Related papers

Related papers: Block-Structured Optimization for Subgraph Detecti…

200 papers

Graph Neural Networks (GNNs) have achieved tremendous success in a variety of real-world applications by relying on the fixed graph data as input. However, the initial input graph might not be optimal in terms of specific downstream tasks,…

Machine Learning · Computer Science 2023-09-22 Beidi Zhao , Boxin Du , Zhe Xu , Liangyue Li , Hanghang Tong

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

This work presents a parallel variant of the algorithm introduced in [Acceleration of block coordinate descent methods with identification strategies Comput. Optim. Appl. 72(3):609--640, 2019] to minimize the sum of a partially separable…

Optimization and Control · Mathematics 2025-08-06 Ronaldo Lopes , Sandra A. Santos , Paulo J. S. Silva

Subgraph pattern detection aims to uncover complex interaction structures in graphs. However, state-of-the-art graph neural network (GNN)-based solutions assume centralized access to the entire graph. When graphs are instead distributed…

Machine Learning · Computer Science 2026-05-08 Selin Ceydeli , Rui Wang , Kubilay Atasu

This work is concerned with the optimization of nonconvex, nonsmooth composite optimization problems, whose objective is a composition of a nonlinear mapping and a nonsmooth nonconvex function, that can be written as an infimal convolution…

Optimization and Control · Mathematics 2018-03-28 Emanuel Laude , Daniel Cremers

We study distributed big-data nonconvex optimization in multi-agent networks. We consider the (constrained) minimization of the sum of a smooth (possibly) nonconvex function, i.e., the agents' sum-utility, plus a convex (possibly) nonsmooth…

Optimization and Control · Mathematics 2018-09-03 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

Gaussian graphical models are widely utilized to infer and visualize networks of dependencies between continuous variables. However, inferring the graph is difficult when the sample size is small compared to the number of variables. To…

Statistics Theory · Mathematics 2016-09-30 Emilie Devijver , Mélina Gallopin

Graphical models provide a powerful methodology for learning the conditional independence structure in multivariate data. Inference is often focused on estimating individual edges in the latent graph. Nonetheless, there is increasing…

Methodology · Statistics 2023-12-15 Willem van den Boom , Maria De Iorio , Alexandros Beskos

Sparse neural networks are shown to give accurate predictions competitive to denser versions, while also minimizing the number of arithmetic operations performed. However current hardware like GPU's can only exploit structured sparsity…

Machine Learning · Computer Science 2020-07-03 Dharma Teja Vooturi , Girish Varma , Kishore Kothapalli

The stochastic block model is able to generate different network partitions, ranging from traditional assortative communities to disassortative structures. Since the degree-corrected stochastic block model does not specify which mixing…

Social and Information Networks · Computer Science 2019-09-16 Xiaoyan Lu , Boleslaw K. Szymanski

This paper presents FLGC, a simple yet effective fully linear graph convolutional network for semi-supervised and unsupervised learning. Instead of using gradient descent, we train FLGC based on computing a global optimal closed-form…

Machine Learning · Computer Science 2021-11-16 Yaoming Cai , Zijia Zhang , Zhihua Cai , Xiaobo Liu , Yao Ding , Pedram Ghamisi

Graph mining analyzes real-world graphs to find core substructures (connected subgraphs) in applications modeled as graphs. Substructure discovery is a process that involves identifying meaningful patterns, structures, or components within…

Social and Information Networks · Computer Science 2025-04-29 Arshdeep Singh , Abhishek Santra , Sharma Chakravarthy

Network detection is an important capability in many areas of applied research in which data can be represented as a graph of entities and relationships. Oftentimes the object of interest is a relatively small subgraph in an enormous,…

Social and Information Networks · Computer Science 2018-04-12 Steven T. Smith , Kenneth D. Senne , Scott Philips , Edward K. Kao , Garrett Bernstein

Over the past two decades, tools from network science have been leveraged to characterize the organization of both structural and functional networks of the brain. One such measure of network organization is hub node identification. Hubs…

Social and Information Networks · Computer Science 2025-09-05 Meiby Ortiz-Bouza , Duc Vu , Abdullah Karaaslanli , Selin Aviyente

In this paper, a modified BFGS algorithm is proposed. The modified BFGS matrix estimates a modified Hessian matrix which is a convex combination of an identity matrix for the steepest descent algorithm and a Hessian matrix for the Newton…

Optimization and Control · Mathematics 2025-11-14 Yaguang Yang

Detection of interesting (e.g., coherent or anomalous) clusters has been studied extensively on plain or univariate networks, with various applications. Recently, algorithms have been extended to networks with multiple attributes for each…

Machine Learning · Computer Science 2018-09-21 Feng Chen , Baojian Zhou , Adil Alim , Liang Zhao

We address the problem of distributed convex unconstrained optimization over networks characterized by asynchronous and possibly lossy communications. We analyze the case where the global cost function is the sum of locally coupled local…

Optimization and Control · Mathematics 2020-10-06 Marco Todescato , Nicoletta Bof , Guido Cavraro , Ruggero Carli , Luca Schenato

In this paper, we study decentralized online stochastic non-convex optimization over a network of nodes. Integrating a technique called gradient tracking in decentralized stochastic gradient descent, we show that the resulting algorithm,…

Optimization and Control · Mathematics 2021-04-21 Ran Xin , Usman A. Khan , Soummya Kar

Stochastic blockmodels (SBM) and their variants, $e.g.$, mixed-membership and overlapping stochastic blockmodels, are latent variable based generative models for graphs. They have proven to be successful for various tasks, such as…

Machine Learning · Computer Science 2019-05-15 Nikhil Mehta , Lawrence Carin , Piyush Rai

A number of inference problems with sensor networks involve projecting a measured signal onto a given subspace. In existing decentralized approaches, sensors communicate with their local neighbors to obtain a sequence of iterates that…