English
Related papers

Related papers: Lower Bounds on Active Learning for Graphical Mode…

200 papers

In this paper, we consider the problem of estimating the underlying graph associated with an Ising model given a number of independent and identically distributed samples. We adopt an \emph{approximate recovery} criterion that allows for a…

Information Theory · Computer Science 2016-07-11 Jonathan Scarlett , Volkan Cevher

The problem of learning the structure of a high dimensional graphical model from data has received considerable attention in recent years. In many applications such as sensor networks and proteomics it is often expensive to obtain samples…

Machine Learning · Statistics 2016-04-08 Gautam Dasarathy , Aarti Singh , Maria-Florina Balcan , Jong Hyuk Park

We present a new active learning algorithm based on nonparametric estimators of the regression function. Our investigation provides probabilistic bounds for the rates of convergence of the generalization error achievable by proposed method…

Statistics Theory · Mathematics 2011-11-03 Stanislav Minsker

We consider the structure learning problem for graphical models that we call loosely connected Markov random fields, in which the number of short paths between any pair of nodes is small, and present a new conditional independence test…

Machine Learning · Statistics 2014-02-05 Rui Wu , R. Srikant , Jian Ni

We develop a unifying framework for information-theoretic lower bound in statistical estimation and interactive decision making. Classical lower bound techniques -- such as Fano's method, Le Cam's method, and Assouad's lemma -- are central…

Machine Learning · Computer Science 2024-12-10 Fan Chen , Dylan J. Foster , Yanjun Han , Jian Qian , Alexander Rakhlin , Yunbei Xu

This paper studies graphical model selection, i.e., the problem of estimating a graph of statistical relationships among a collection of random variables. Conventional graphical model selection algorithms are passive, i.e., they require all…

Machine Learning · Statistics 2014-04-15 Divyanshu Vats , Robert D. Nowak , Richard G. Baraniuk

Markov random fields area popular model for high-dimensional probability distributions. Over the years, many mathematical, statistical and algorithmic problems on them have been studied. Until recently, the only known algorithms for…

Machine Learning · Computer Science 2017-06-01 Linus Hamilton , Frederic Koehler , Ankur Moitra

Graph learning problems are typically approached by focusing on learning the topology of a single graph when signals from all nodes are available. However, many contemporary setups involve multiple related networks and, moreover, it is…

Signal Processing · Electrical Eng. & Systems 2022-12-06 Samuel Rey , Madeline Navarro , Andrei Buciulea , Santiago Segarra , Antonio G. Marques

This paper investigates the active sampling for estimation of approximately bandlimited graph signals. With the assistance of a graph filter, an approximately bandlimited graph signal can be formulated by a Gaussian random field over the…

Signal Processing · Electrical Eng. & Systems 2019-02-19 Sijie Lin , Xuan Xie , Hui Feng , Bo Hu

Active learning is typically used to label data, when the labeling process is expensive. Several active learning algorithms have been theoretically proved to perform better than their passive counterpart. However, these algorithms rely on…

Machine Learning · Computer Science 2021-02-23 Boris Ndjia Njike , Xavier Siebert

The problem of structure estimation in graphical models with latent variables is considered. We characterize conditions for tractable graph estimation and develop efficient methods with provable guarantees. We consider models where the…

Machine Learning · Statistics 2013-04-23 Animashree Anandkumar , Ragupathyraj Valluvan

A well-studied challenge that arises in the structure learning problem of causal directed acyclic graphs (DAG) is that using observational data, one can only learn the graph up to a "Markov equivalence class" (MEC). The remaining undirected…

Machine Learning · Computer Science 2022-05-20 Vibhor Porwal , Piyush Srivastava , Gaurav Sinha

This paper studies graph-based active learning, where the goal is to reconstruct a binary signal defined on the nodes of a weighted graph, by sampling it on a small subset of the nodes. A new sampling algorithm is proposed, which…

Machine Learning · Computer Science 2016-05-19 Eyal En Gad , Akshay Gadde , A. Salman Avestimehr , Antonio Ortega

Directed and undirected graphical models, also called Bayesian networks and Markov random fields, respectively, are important statistical tools in a wide variety of fields, ranging from computational biology to probabilistic artificial…

Combinatorics · Mathematics 2007-06-13 Sergi Elizalde , Kevin Woods

We consider a sequential learning problem with Gaussian payoffs and side information: after selecting an action $i$, the learner receives information about the payoff of every action $j$ in the form of Gaussian observations whose mean is…

Machine Learning · Statistics 2015-10-29 Yifan Wu , András György , Csaba Szepesvári

This paper provides a general technique for lower bounding the Bayes risk of statistical estimation, applicable to arbitrary loss functions and arbitrary prior distributions. A lower bound on the Bayes risk not only serves as a lower bound…

Statistics Theory · Mathematics 2016-12-26 Xi Chen , Adityanand Guntuboyina , Yuchen Zhang

This paper builds theoretical foundations for the recovery of a newly proposed class of smooth graph signals, approximately bandlimited graph signals, under three sampling strategies: uniform sampling, experimentally designed sampling and…

Information Theory · Computer Science 2017-02-21 Siheng Chen , Rohan Varma , Aarti Singh , Jelena Kovačević

We consider the problem of learning a conditional Gaussian graphical model in the presence of latent variables. Building on recent advances in this field, we suggest a method that decomposes the parameters of a conditional Markov random…

Methodology · Statistics 2017-03-07 Benjamin Frot , Luke Jostins , Gil McVean

We consider distributed parameter estimation using interactive protocols subject to local information constraints such as bandwidth limitations, local differential privacy, and restricted measurements. We provide a unified framework…

Data Structures and Algorithms · Computer Science 2022-11-17 Jayadev Acharya , Clément L. Canonne , Ziteng Sun , Himanshu Tyagi

We establish empirical risk minimization principles for active learning by deriving a family of upper bounds on the generalization error. Aligning with empirical observations, the bounds suggest that superior query algorithms can be…

Machine Learning · Statistics 2024-09-17 Vincent Menden , Yahya Saleh , Armin Iske
‹ Prev 1 2 3 10 Next ›