English
Related papers

Related papers: Approximate $l_0$-penalized estimation of piecewis…

200 papers

This paper introduces a flexible regularization approach that reduces point estimation risk of group means stemming from e.g. categorical regressors, (quasi-)experimental data or panel data models. The loss function is penalized by adding…

Econometrics · Economics 2019-01-08 Phillip Heiler , Jana Mareckova

In this letter, we study distributed optimization, where a network of agents, abstracted as a directed graph, collaborates to minimize the average of locally-known convex functions. Most of the existing approaches over directed graphs are…

Optimization and Control · Mathematics 2018-06-08 Ran Xin , Usman A. Khan

We study the asymptotics for jump-penalized least squares regression aiming at approximating a regression function by piecewise constant functions. Besides conventional consistency and convergence rates of the estimates in $L^2([0,1))$ our…

Statistics Theory · Mathematics 2009-03-02 Leif Boysen , Angela Kempe , Volkmar Liebscher , Axel Munk , Olaf Wittich

In this paper we study minimax and adaptation rates in general isotonic regression. For uniform deterministic and random designs in $[0,1]^d$ with $d\ge 2$ and $N(0,1)$ noise, the minimax rate for the $\ell_2$ risk is known to be bounded…

Statistics Theory · Mathematics 2020-01-13 Hang Deng , Cun-Hui Zhang

We study the problem of learning the causal relationships between a set of observed variables in the presence of latents, while minimizing the cost of interventions on the observed variables. We assume access to an undirected graph $G$ on…

Data Structures and Algorithms · Computer Science 2020-12-29 Raghavendra Addanki , Andrew McGregor , Cameron Musco

In this work we propose and analyze a novel approach for group sparse recovery. It is based on regularized least squares with an $\ell^0(\ell^2)$ penalty, which penalizes the number of nonzero groups. One distinct feature of the approach is…

Information Theory · Computer Science 2016-12-21 Yuling Jiao , Bangti Jin , Xiliang Lu

Sampling and interpolation have been extensively studied, in order to reconstruct or estimate the entire graph signal from the signal values on a subset of vertexes, of which most achievements are about continuous signals. While in a lot of…

Signal Processing · Electrical Eng. & Systems 2021-09-28 Wenwei Liu , Hui Feng , Kaixuan Wang , Feng Ji , Bo Hu

We develop fast algorithms for solving regression problems on graphs where one is given the value of a function at some vertices, and must find its smoothest possible extension to all vertices. The extension we compute is the absolutely…

Machine Learning · Computer Science 2015-07-01 Rasmus Kyng , Anup Rao , Sushant Sachdeva , Daniel A. Spielman

We study the quantization of real-valued bandlimited signals on graphs, focusing on low-bit representations. We propose iterative noise-shaping algorithms for quantization, including sampling approaches with and without vertex replacement.…

Signal Processing · Electrical Eng. & Systems 2026-01-27 Felix Krahmer , He Lyu , Rayan Saab , Jinna Qian , Anna Veselovska , Rongrong Wang

This paper explores the estimation of a panel data model with cross-sectional interaction that is flexible both in its approach to specifying the network of connections between cross-sectional units, and in controlling for unobserved…

Econometrics · Economics 2021-11-23 Ayden Higgins , Federico Martellosio

We present a new approach to solve the sparse approximation or best subset selection problem, namely find a $k$-sparse vector ${\bf x}\in\mathbb{R}^d$ that minimizes the $\ell_2$ residual $\lVert A{\bf x}-{\bf y} \rVert_2$. We consider a…

Machine Learning · Computer Science 2021-06-21 Tal Amir , Ronen Basri , Boaz Nadler

It is well known that $\ell_1$ minimization can be used to recover sufficiently sparse unknown signals from compressed linear measurements. In fact, exact thresholds on the sparsity, as a function of the ratio between the system dimensions,…

Information Theory · Computer Science 2011-11-08 M. Amin Khajehnejad , Weiyu Xu , A. Salman Avestimehr , Babak Hassibi

Random graph alignment refers to recovering the underlying vertex correspondence between two random graphs with correlated edges. This can be viewed as an average-case and noisy version of the well-known graph isomorphism problem. For the…

Machine Learning · Statistics 2021-08-18 Luca Ganassali , Laurent Massoulié , Marc Lelarge

In this paper, we consider the problem of recovering a sparse signal based on penalized least squares formulations. We develop a novel algorithm of primal-dual active set type for a class of nonconvex sparsity-promoting penalties, including…

Optimization and Control · Mathematics 2019-02-28 Jian Huang , Yuling Jiao , Bangti Jin , Jin Liu , Xiliang Lu , Can Yang

This paper studies the problem of recovering a hidden vertex correspondence between two correlated graphs when both edge weights and node features are observed. While most existing work on graph alignment relies primarily on edge…

Statistics Theory · Mathematics 2026-04-07 Dong Huang , Chenyang Tian , Pengkun Yang

We study an NP-hard problem motivated by energy-efficiently maintaining the connectivity of a symmetric wireless communication network: Given an edge-weighted $n$-vertex graph, find a connected spanning subgraph of minimum cost, where the…

Data Structures and Algorithms · Computer Science 2022-03-23 Matthias Bentert , René van Bevern , André Nichterlein , Rolf Niedermeier , Pavel V. Smirnov

In this paper, we study nonparametric estimation of instrumental variable (IV) regressions. Recently, many flexible machine learning methods have been developed for instrumental variable estimation. However, these methods have at least one…

Machine Learning · Statistics 2023-02-13 Andrew Bennett , Nathan Kallus , Xiaojie Mao , Whitney Newey , Vasilis Syrgkanis , Masatoshi Uehara

We propose a time-varying graph signal recovery method for estimating the true time-varying graph signal from corrupted observations by leveraging dynamic graphs. Most of the conventional methods for time-varying graph signal recovery have…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Eisuke Yamagata , Kazuki Naganuma , Shunsuke Ono

We investigate the problem of sequentially predicting the binary labels on the nodes of an arbitrary weighted graph. We show that, under a suitable parametrization of the problem, the optimal number of prediction mistakes can be…

Machine Learning · Computer Science 2012-12-27 Nicolo' Cesa-Bianchi , Claudio Gentile , Fabio Vitale , Giovanni Zappella

In many real-world applications, it is undesirable to drastically change the problem solution after a small perturbation in the input, as unstable outputs can lead to costly transaction fees, privacy and security concerns, reduced user…

Data Structures and Algorithms · Computer Science 2025-11-11 Quanquan C. Liu , Grigoris Velegkas , Yuichi Yoshida , Felix Zhou
‹ Prev 1 4 5 6 7 8 10 Next ›