English
Related papers

Related papers: Generalized Stability Approach for Regularized Gra…

200 papers

Orienting the edges of an undirected graph such that the resulting digraph satisfies some given constraints is a classical problem in graph theory, with multiple algorithmic applications. In particular, an $st$-orientation orients each edge…

Data Structures and Algorithms · Computer Science 2023-07-11 Carla Binucci , Giuseppe Liotta , Fabrizio Montecchiani , Giacomo Ortali , Tommaso Piselli

In high-dimensional generalized linear models, it is crucial to identify a sparse model that adequately accounts for response variation. Although the best subset section has been widely regarded as the Holy Grail of problems of this type,…

Machine Learning · Statistics 2023-08-02 Junxian Zhu , Jin Zhu , Borui Tang , Xuanyu Chen , Hongmei Lin , Xueqin Wang

Benefiting from the message passing mechanism, Graph Neural Networks (GNNs) have been successful on flourish tasks over graph data. However, recent studies have shown that attackers can catastrophically degrade the performance of GNNs by…

Machine Learning · Computer Science 2023-04-24 Kuan Li , Yang Liu , Xiang Ao , Jianfeng Chi , Jinghua Feng , Hao Yang , Qing He

Graph anomaly detection (GAD) is a challenging binary classification problem due to its different structural distribution between anomalies and normal nodes -- abnormal nodes are a minority, therefore holding high heterophily and low…

Machine Learning · Computer Science 2024-01-26 Yuan Gao , Xiang Wang , Xiangnan He , Zhenguang Liu , Huamin Feng , Yongdong Zhang

In most domains of network analysis researchers consider networks that arise in nature with weighted edges. Such networks are routinely dichotomized in the interest of using available methods for statistical inference with networks. The…

Methodology · Statistics 2016-11-10 James D. Wilson , Matthew J. Denny , Shankar Bhamidi , Skyler Cranmer , Bruce Desmarais

Graph neural networks have demonstrated excellent applicability to a wide range of domains, including social networks, biological systems, recommendation systems, and wireless communications. Yet a principled theoretical understanding of…

Machine Learning · Computer Science 2026-04-14 Xinping Yi

Consider the problem of simultaneous estimation and support recovery of the coefficient vector in a linear data model with additive Gaussian noise. We study the problem of estimating the model coefficients based on a recently proposed…

Statistics Theory · Mathematics 2022-11-15 Soham Jana , Henry Li , Yutaro Yamada , Ofir Lindenbaum

Physics-informed neural networks have emerged as a powerful tool in the scientific machine learning community, with applications to both forward and inverse problems. While they have shown considerable empirical success, significant…

Optimization and Control · Mathematics 2025-12-11 Federica Caforio , Martin Holler , Matthias Höfler

Regularized m-estimators are widely used due to their ability of recovering a low-dimensional model in high-dimensional scenarios. Some recent efforts on this subject focused on creating a unified framework for establishing oracle bounds,…

Methodology · Statistics 2023-09-06 Eduardo F. Mendes , Gabriel J. P. Pinto

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

Artificial Intelligence · Computer Science 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

Graph convolutional networks (GCN) are viewed as one of the most popular representations among the variants of graph neural networks over graph data and have shown powerful performance in empirical experiments. That $\ell_2$-based graph…

Machine Learning · Computer Science 2023-06-21 Shiyu Liu , Linsen Wei , Shaogao Lv , Ming Li

Recently there are a considerable amount of work devoted to the study of the algorithmic stability and generalization for stochastic gradient descent (SGD). However, the existing stability analysis requires to impose restrictive assumptions…

Machine Learning · Computer Science 2020-06-16 Yunwen Lei , Yiming Ying

We present a novel k-way high-dimensional graphical model called the Generalized Root Model (GRM) that explicitly models dependencies between variable sets of size k > 2---where k = 2 is the standard pairwise graphical model. This model is…

Machine Learning · Statistics 2016-06-03 David I. Inouye , Pradeep Ravikumar , Inderjit S. Dhillon

This work addresses the problem of graph learning from data following a Gaussian Graphical Model (GGM) with a time-varying mean. Graphical Lasso (GL), the standard method for estimating sparse precision matrices, assumes that the observed…

Machine Learning · Computer Science 2025-03-26 Samuel Rey , Ernesto Curbelo , Luca Martino , Fernando Llorente , Antonio G. Marques

We consider distributed optimization methods for problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We leverage randomized sketches for reducing the problem dimensions as well as…

Optimization and Control · Mathematics 2022-03-21 Burak Bartan , Mert Pilanci

Graph Neural Networks (GNNs) have shown to be powerful tools for graph analytics. The key idea is to recursively propagate and aggregate information along edges of the given graph. Despite their success, however, the existing GNNs are…

Machine Learning · Computer Science 2020-11-16 Dongsheng Luo , Wei Cheng , Wenchao Yu , Bo Zong , Jingchao Ni , Haifeng Chen , Xiang Zhang

Many real-world datasets can be naturally represented as graphs, spanning a wide range of domains. However, the increasing complexity and size of graph datasets present significant challenges for analysis and computation. In response, graph…

Social and Information Networks · Computer Science 2024-07-02 Mohammad Hashemi , Shengbo Gong , Juntong Ni , Wenqi Fan , B. Aditya Prakash , Wei Jin

Sparse high dimensional graphical model selection is a popular topic in contemporary machine learning. To this end, various useful approaches have been proposed in the context of $\ell_1$-penalized estimation in the Gaussian framework.…

Computation · Statistics 2022-02-04 Sang-Yun Oh , Onkar Dalal , Kshitij Khare , Bala Rajaratnam

Exponential Random Graph Models (ERGM) behave peculiar in large networks with thousand(s) of actors (nodes). Standard models containing two-star or triangle counts as statistics are often unstable leading to completely full or empty…

Applications · Statistics 2016-04-19 Stephanie Thiemichen , Göran Kauermann

We develop a data-driven machine learning approach to identifying parameters with steady-state solutions, locating such solutions, and determining their linear stability for systems of ordinary differential equations and dynamical systems…

Numerical Analysis · Mathematics 2025-03-11 Yimeng Zhang , Alexander Cloninger , Bo Li , Xiaochuan Tian