English
Related papers

Related papers: Lower Bounds on Active Learning for Graphical Mode…

200 papers

Graph neural networks use relational information as an inductive bias to enhance prediction performance. Not rarely, task-relevant relations are unknown and graph structure learning approaches have been proposed to learn them from data.…

Machine Learning · Computer Science 2025-05-29 Alessandro Manenti , Daniele Zambon , Cesare Alippi

We analyze the necessary number of samples for sparse vector recovery in a noisy linear prediction setup. This model includes problems such as linear regression and classification. We focus on structured graph models. In particular, we…

Machine Learning · Computer Science 2018-11-19 Adarsh Barik , Jean Honorio , Mohit Tawarmalani

Structured prediction can be considered as a generalization of many standard supervised learning tasks, and is usually thought as a simultaneous prediction of multiple labels. One standard approach is to maximize a score function on the…

Machine Learning · Computer Science 2021-02-19 Kevin Bello , Asish Ghoshal , Jean Honorio

This work addresses various open questions in the theory of active learning for nonparametric classification. Our contributions are both statistical and algorithmic: -We establish new minimax-rates for active learning under common…

Machine Learning · Statistics 2017-03-20 Andrea Locatelli , Alexandra Carpentier , Samory Kpotufe

Due to the privacy protection or the difficulty of data collection, we cannot observe individual outputs for each instance, but we can observe aggregated outputs that are summed over multiple instances in a set in some real-world…

Machine Learning · Statistics 2022-10-05 Tomoharu Iwata

Estimating and optimizing Mutual Information (MI) is core to many problems in machine learning; however, bounding MI in high dimensions is challenging. To establish tractable and scalable objectives, recent work has turned to variational…

Machine Learning · Computer Science 2019-05-17 Ben Poole , Sherjil Ozair , Aaron van den Oord , Alexander A. Alemi , George Tucker

We give the first efficient algorithm for learning the structure of an Ising model that tolerates independent failures; that is, each entry of the observed sample is missing with some unknown probability p. Our algorithm matches the…

Data Structures and Algorithms · Computer Science 2019-02-14 Surbhi Goel , Daniel M. Kane , Adam R. Klivans

Graph inference plays an essential role in machine learning, pattern recognition, and classification. Signal processing based approaches in literature generally assume some variational property of the observed data on the graph. We make a…

Information Theory · Computer Science 2020-08-24 B. Subbareddy , Aditya Siripuram , Jingxin Zhang

Autoregressive models enable tractable sampling from learned probability distributions, but their performance critically depends on the variable ordering used in the factorization via complexities of the resulting conditional distributions.…

Machine Learning · Statistics 2026-03-04 Shiba Biswal , Marc Vuffray , Andrey Y. Lokhov

Graph embedding provides an efficient solution for graph analysis by converting the graph into a low-dimensional space which preserves the structure information. In contrast to the graph structure data, the i.i.d. node embedding can be…

Machine Learning · Computer Science 2017-05-16 Hongyun Cai , Vincent W. Zheng , Kevin Chen-Chuan Chang

We investigate the problem of active learning in the streaming setting in non-parametric regimes, where the labels are stochastically generated from a class of functions on which we make no assumptions whatsoever. We rely on recently…

Machine Learning · Computer Science 2021-06-08 Pranjal Awasthi , Christoph Dann , Claudio Gentile , Ayush Sekhari , Zhilei Wang

In neuroimaging data analysis, Gaussian graphical models are often used to model statistical dependencies across spatially remote brain regions known as functional connectivity. Typically, data is collected across a cohort of subjects and…

Machine Learning · Statistics 2015-12-08 Ricardo Pio Monti , Christoforos Anagnostopoulos , Giovanni Montana

Graph convolution networks (GCN) have emerged as the leading method to classify node classes in networks, and have reached the highest accuracy in multiple node classification tasks. In the absence of available tagged samples, active…

Machine Learning · Computer Science 2019-06-21 Roy Abel , Yoram Louzoun

We study a variant of prediction with expert advice where the learner's action at round $t$ is only allowed to depend on losses on a specific subset of the rounds (where the structure of which rounds' losses are visible at time $t$ is…

Machine Learning · Computer Science 2024-07-02 Khashayar Gatmiry , Jon Schneider

Active learning refers to the learning protocol where the learner is allowed to choose a subset of instances for labeling. Previous studies have shown that, compared with passive learning, active learning is able to reduce the label…

Machine Learning · Computer Science 2014-02-07 Lijun Zhang , Mehrdad Mahdavi , Rong Jin

Graph neural networks, trained on experimental or calculated data are becoming an increasingly important tool in computational materials science. Networks, once trained, are able to make highly accurate predictions at a fraction of the cost…

Materials Science · Physics 2024-06-19 Johannes Allotey , Keith T. Butler , Jeyan Thiyagalingam

We consider the problem of learning the underlying graph of an unknown Ising model on p spins from a collection of i.i.d. samples generated from the model. We suggest a new estimator that is computationally efficient and requires a number…

Machine Learning · Computer Science 2017-04-17 Marc Vuffray , Sidhant Misra , Andrey Y. Lokhov , Michael Chertkov

Computing the probability of evidence even with known error bounds is NP-hard. In this paper we address this hard problem by settling on an easier problem. We propose an approximation which provides high confidence lower bounds on…

Artificial Intelligence · Computer Science 2012-06-26 Vibhav Gogate , Bozhena Bidyuk , Rina Dechter

The most relevant problems in discounted reinforcement learning involve estimating the mean of a function under the stationary distribution of a Markov reward process, such as the expected return in policy evaluation, or the policy gradient…

Machine Learning · Computer Science 2023-04-17 Alberto Maria Metelli , Mirco Mutti , Marcello Restelli

We consider the problem of detecting a tight community in a sparse random network. This is formalized as testing for the existence of a dense random subgraph in a random graph. Under the null hypothesis, the graph is a realization of an…

Statistics Theory · Mathematics 2014-09-26 Ery Arias-Castro , Nicolas Verzelen