English
Related papers

Related papers: Regression on a Graph

200 papers

We consider estimating the edge-probability matrix of a network generated from a graphon model when the full network is not observed---only some overlapping subgraphs are. We extend the neighbourhood smoothing (NBS) algorithm of Zhang et…

Machine Learning · Statistics 2019-06-28 Soumendu Sundar Mukherjee , Sayak Chakrabarti

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

Optimization and Control · Mathematics 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

When facing graph signal processing tasks, the workhorse assumption is that the graph describing the support of the signals is known. However, in many relevant applications the available graph suffers from observation errors and…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Samuel Rey , Victor M. Tenorio , Antonio G. Marques

A method for estimating nonlinear regression errors and their distributions without performing regression is presented. Assuming continuity of the modeling function the variance is given in terms of conditional probabilities extracted from…

Machine Learning · Statistics 2014-04-15 Hong Pi , Carsten Peterson

The bridge regression estimator generalizes both ridge regression and LASSO estimators. Since it minimizes the sum of squared residuals with a $L_{\gamma }$ penalty, this estimator is typically not robust against outliers in the data. There…

Methodology · Statistics 2015-11-26 Olcay Arslan

This work focuses on the estimation of multiple change-points in a time-varying Ising model that evolves piece-wise constantly. The aim is to identify both the moments at which significant changes occur in the Ising model, as well as the…

Machine Learning · Statistics 2020-07-01 Batiste Le Bars , Pierre Humbert , Argyris Kalogeratos , Nicolas Vayatis

We study functional regression with random subgaussian design and real-valued response. The focus is on the problems in which the regression function can be well approximated by a functional linear model with the slope function being…

Statistics Theory · Mathematics 2014-09-16 Vladimir Koltchinskii , Stanislav Minsker

We study the complexity of the entire regularization path for least squares regression with 1-norm penalty, known as the Lasso. Every regression parameter in the Lasso changes linearly as a function of the regularization value. The number…

Data Structures and Algorithms · Computer Science 2018-06-11 Yuanzhi Li , Yoram Singer

Graph-based methods have been quite successful in solving unsupervised and semi-supervised learning problems, as they provide a means to capture the underlying geometry of the dataset. It is often desirable for the constructed graph to…

Machine Learning · Computer Science 2019-04-16 Aamir Anis , Aly El Gamal , Salman Avestimehr , Antonio Ortega

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

Computation · Statistics 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

Anomaly detection in complex domains poses significant challenges due to the need for extensive labeled data and the inherently imbalanced nature of anomalous versus benign samples. Graph-based machine learning models have emerged as a…

Machine Learning · Computer Science 2025-07-21 Yifan Wei , Anwar Said , Waseem Abbas , Xenofon Koutsoukos

Current graph neural networks (GNNs) that tackle node classification on graphs tend to only focus on nodewise scores and are solely evaluated by nodewise metrics. This limits uncertainty estimation on graphs since nodewise marginals do not…

Machine Learning · Computer Science 2022-10-28 Hans Hao-Hsun Hsu , Yuesong Shen , Daniel Cremers

Penalized generalized estimating equations with Elastic Net or L2-Smoothly Clipped Absolute Deviation penalization are proposed to simultaneously select the most important variables and estimate their effects for longitudinal Gaussian data…

Methodology · Statistics 2012-11-26 Adriaan Blommaert , Niel Hens , Philippe Beutels

$\ell_1$-penalized quantile regression is widely used for analyzing high-dimensional data with heterogeneity. It is now recognized that the $\ell_1$-penalty introduces non-negligible estimation bias, while a proper use of concave…

Methodology · Statistics 2021-09-14 Kean Ming Tan , Lan Wang , Wen-Xin Zhou

Sparse models for high-dimensional linear regression and machine learning have received substantial attention over the past two decades. Model selection, or determining which features or covariates are the best explanatory variables, is…

Machine Learning · Statistics 2019-10-15 Yuan Li , Benjamin Mark , Garvesh Raskutti , Rebecca Willett , Hyebin Song , David Neiman

Network analysis is an important tool in understanding the behavior of complex systems of interacting entities. However, due to the limitations of data gathering technologies, some interactions might be missing from the network model. This…

Social and Information Networks · Computer Science 2016-08-25 Soumya Sarkar , Sanjukta Bhowmick , Suhansanu Kumar , Animesh Mukherjee

In the past decades, the growing amount of network data has lead to many novel statistical models. In this paper we consider so called geometric networks. Typical examples are road networks or other infrastructure networks. But also the…

Methodology · Statistics 2020-02-25 Marc Schneble , Göran Kauermann

This paper presents a robust regression approach for image binarization under significant background variations and observation noises. The work is motivated by the need of identifying foreground regions in noisy microscopic image or…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Garret Vo , Chiwoo Park

Imposition of a lasso penalty shrinks parameter estimates toward zero and performs continuous model selection. Lasso penalized regression is capable of handling linear regression problems where the number of predictors far exceeds the…

Applications · Statistics 2008-12-18 Tong Tong Wu , Kenneth Lange

Over the last decade, signal processing on graphs has become a very active area of research. Specifically, the number of applications, for instance in statistical or deep learning, using frames built from graphs, such as wavelets on graphs,…

Signal Processing · Electrical Eng. & Systems 2023-03-08 Elie Chedemail , Basile de Loynes , Fabien Navarro , Baptiste Olivier