English
Related papers

Related papers: Graph-based regularization for regression problems…

200 papers

Conformal prediction has become increasingly popular for quantifying the uncertainty associated with machine learning models. Recent work in graph uncertainty quantification has built upon this approach for conformal graph prediction. The…

Machine Learning · Computer Science 2025-05-21 Pranav Maneriker , Aditya T. Vadlamani , Anutam Srinivasan , Yuntian He , Ali Payani , Srinivasan Parthasarathy

This paper presents a bias-variance tradeoff of graph Laplacian regularizer, which is widely used in graph signal processing and semi-supervised learning tasks. The scaling law of the optimal regularization parameter is specified in terms…

Machine Learning · Statistics 2017-08-02 Pin-Yu Chen , Sijia Liu

Graphs are fundamental mathematical structures used in various fields to represent data, signals and processes. In this paper, we propose a novel framework for learning/estimating graphs from data. The proposed framework includes (i)…

Machine Learning · Computer Science 2017-07-07 Hilmi E. Egilmez , Eduardo Pavez , Antonio Ortega

As the benchmark of data-driven control methods, the linear quadratic regulator (LQR) problem has gained significant attention. A growing trend is direct LQR design, which finds the optimal LQR gain directly from raw data and bypassing…

Systems and Control · Electrical Eng. & Systems 2025-03-06 Feiran Zhao , Alessandro Chiuso , Florian Dörfler

In many applications, linear models fit the data poorly. This article studies an appealing alternative, the generalized regression model. This model only assumes that there exists an unknown monotonically increasing link function connecting…

Methodology · Statistics 2017-07-24 Fang Han , Hongkai Ji , Zhicheng Ji , Honglang Wang

Learning a smooth graph signal from partially observed data is a well-studied task in graph-based machine learning. We consider this task from the perspective of optimal recovery, a mathematical framework for learning a function from…

Machine Learning · Computer Science 2023-05-31 Simon Foucart , Chunyang Liao , Nate Veldt

Graph matching is a challenging problem with very important applications in a wide range of fields, from image and video analysis to biological and biomedical problems. We propose a robust graph matching algorithm inspired in…

Optimization and Control · Mathematics 2013-11-26 Marcelo Fiori , Pablo Sprechmann , Joshua Vogelstein , Pablo Musé , Guillermo Sapiro

We propose a novel benchmarking methodology for graph neural networks (GNNs) based on the graph alignment problem, a combinatorial optimization task that generalizes graph isomorphism by aligning two unlabeled graphs to maximize overlapping…

Machine Learning · Computer Science 2025-05-20 Adrien Lagesse , Marc Lelarge

We investigate the high-dimensional linear regression problem in the presence of noise correlated with Gaussian covariates. This correlation, known as endogeneity in regression models, often arises from unobserved variables and other…

Statistics Theory · Mathematics 2023-10-23 Toshiki Tsuda , Masaaki Imaizumi

Sparse high dimensional graphical model selection is a topic of much interest in modern day statistics. A popular approach is to apply l1-penalties to either (1) parametric likelihoods, or, (2) regularized regression/pseudo-likelihoods,…

Methodology · Statistics 2022-02-04 Kshitij Khare , Sang-Yun Oh , Bala Rajaratnam

Regression models with both high-dimensional responses and covariates have attracted growing attention. Standard multivariate regression models become inadequate when the response variables depend not only on observed covariates but also on…

Methodology · Statistics 2026-05-01 Jing Ouyang , Chengyu Cui , Yunxiao Chen , Kean Ming Tan , Gongjun Xu

Graph alignment aims at finding the vertex correspondence between two correlated graphs, a task that frequently occurs in graph mining applications such as social network analysis. Attributed graph alignment is a variant of graph alignment,…

Data Structures and Algorithms · Computer Science 2024-03-13 Ziao Wang , Ning Zhang , Weina Wang , Lele Wang

We consider the problem of exact and inexact matching of weighted undirected graphs, in which a bijective correspondence is sought to minimize a quadratic weight disagreement. This computationally challenging problem is often relaxed as a…

Data Structures and Algorithms · Computer Science 2014-10-14 Yonathan Aflalo , Alex Bronstein , Ron Kimmel

Selecting regularization parameters in penalized high-dimensional graphical models in a principled, data-driven, and computationally efficient manner continues to be one of the key challenges in high-dimensional statistics. We present…

Methodology · Statistics 2016-10-19 Christian L. Müller , Richard Bonneau , Zachary Kurtz

Gaussian graphical models are a popular tool to learn the dependence structure in the form of a graph among variables of interest. Bayesian methods have gained in popularity in the last two decades due to their ability to simultaneously…

Statistics Theory · Mathematics 2019-04-02 Yabo Niu , Debdeep Pati , Bani Mallick

Many modern data analysis algorithms either assume that or are considerably more efficient if the distances between the data points satisfy a metric. These algorithms include metric learning, clustering, and dimensionality reduction.…

Data Structures and Algorithms · Computer Science 2018-07-23 Anna C. Gilbert , Rishi Sonthalia

We consider the problem of learning a graph from a finite set of noisy graph signal observations, the goal of which is to find a smooth representation of the graph signal. Such a problem is motivated by the desire to infer relational…

Machine Learning · Computer Science 2023-02-08 Xiaolu Wang , Yuen-Man Pun , Anthony Man-Cho So

Machine learning models that can exploit the inherent structure in data have gained prominence. In particular, there is a surge in deep learning solutions for graph-structured data, due to its wide-spread applicability in several fields.…

Machine Learning · Computer Science 2020-02-12 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Andreas Spanias

We study a family of regularized score-based estimators for learning the structure of a directed acyclic graph (DAG) for a multivariate normal distribution from high-dimensional data with $p\gg n$. Our main results establish support…

Statistics Theory · Mathematics 2017-10-03 Bryon Aragam , Arash A. Amini , Qing Zhou

We consider a setting where multiple entities inter-act with each other over time and the time-varying statuses of the entities are represented as multiple correlated time series. For example, speed sensors are deployed in different…

Machine Learning · Computer Science 2021-03-23 Razvan-Gabriel Cirstea , Chenjuan Guo , Bin Yang