English
Related papers

Related papers: Sparse network asymptotics for logistic regression

200 papers

In this article we prove a Generalized Asypmtotic Equipartition Property for Networked Data Structures modelled as coloured random graphs. The main techniques in this article remains large deviation principles for suitably defined empirical…

Information Theory · Computer Science 2017-12-19 K. Doku-Amponsah

This paper provides a selective review of the statistical network analysis literature focused on clustering and inference problems for stochastic blockmodels and their variants. We survey asymptotic normality results for stochastic…

Statistics Theory · Mathematics 2025-01-24 Joshua Agterberg , Joshua Cape

We provide a discussion of several recent results which, in certain scenarios, are able to overcome a barrier in distributed stochastic optimization for machine learning. Our focus is the so-called asymptotic network independence property,…

Optimization and Control · Mathematics 2020-02-19 Shi Pu , Alex Olshevsky , Ioannis Ch. Paschalidis

Demand forecasting is a crucial component of demand management. While shortening the forecasting horizon allows for more recent data and less uncertainty, this frequently means lower data aggregation levels and a more significant data…

Machine Learning · Computer Science 2021-03-26 Jože M. Rožanec , Dunja Mladenić

We analyze a coupled anonymized dataset collecting the mobile phone communication and bank transactions history of a large number of individuals. After mapping the social structure and introducing indicators of socioeconomic status,…

Social and Information Networks · Computer Science 2017-12-25 Yannick Leo , Márton Karsai , Carlos Sarraute , Eric Fleury

This paper studies identification and estimation in semiparametric logit models when social networks are endogenous. In many applications, unobserved individual traits shape both the outcome of interest and the formation of social ties, so…

Econometrics · Economics 2026-03-13 Brice Romuald Gueyap Kounga

If multiway cluster-robust standard errors are used routinely in applied economics, surprisingly few theoretical results justify this practice. This paper aims to fill this gap. We first prove, under nearly the same conditions as with…

Econometrics · Economics 2018-08-06 Laurent Davezies , Xavier D'Haultfoeuille , Yannick Guyonvarch

Online sparse linear regression is an online problem where an algorithm repeatedly chooses a subset of coordinates to observe in an adversarially chosen feature vector, makes a real-valued prediction, receives the true label, and incurs the…

Machine Learning · Computer Science 2020-07-27 Satyen Kale , Zohar Karnin , Tengyuan Liang , Dávid Pál

Stochastic gradient algorithms are more and more studied since they can deal efficiently and online with large samples in high dimensional spaces. In this paper, we first establish a Central Limit Theorem for these estimates as well as for…

Statistics Theory · Mathematics 2017-10-17 Antoine Godichon-Baggioni

Thompson sampling has been shown to be an effective policy across a variety of online learning tasks. Many works have analyzed the finite time performance of Thompson sampling, and proved that it achieves a sub-linear regret under a broad…

Machine Learning · Computer Science 2020-11-10 Cem Kalkanli , Ayfer Ozgur

While logistic regression models are easily accessible to researchers, when applied to network data there are unrealistic assumptions made about the dependence structure of the data. For temporal networks measured in discrete time, recent…

Methodology · Statistics 2020-05-20 Daniel K. Sewell

In this paper, a sparsity-aware adaptive algorithm for distributed learning in diffusion networks is developed. The algorithm follows the set-theoretic estimation rationale. At each time instance and at each node of the network, a closed…

Information Theory · Computer Science 2015-06-03 Symeon Chouvardas , Konstantinos Slavakis , Yannis Kopsinis , Sergios Theodoridis

Causal inference with observational studies often relies on the assumptions of unconfoundedness and overlap of covariate distributions in different treatment groups. The overlap assumption is violated when some units have propensity scores…

Methodology · Statistics 2022-07-19 Shu Yang , Peng Ding

Latent variable models for network data extract a summary of the relational structure underlying an observed network. The simplest possible models subdivide nodes of the network into clusters; the probability of a link between any two nodes…

Machine Learning · Computer Science 2012-07-03 Konstantina Palla , David Knowles , Zoubin Ghahramani

Stochastic neural networks are a prototypical computational device able to build a probabilistic representation of an ensemble of external stimuli. Building on the relationship between inference and learning, we derive a synaptic plasticity…

Disordered Systems and Neural Networks · Physics 2018-10-23 Luca Saglietti , Federica Gerace , Alessandro Ingrosso , Carlo Baldassi , Riccardo Zecchina

This work studies the learning ability of consensus and diffusion distributed learners from continuous streams of data arising from different but related statistical distributions. Four distinctive features for diffusion learners are…

Optimization and Control · Mathematics 2016-07-19 Zaid J. Towfic , Jianshu Chen , Ali H. Sayed

We consider shallow (single hidden layer) neural networks and characterize their performance when trained with stochastic gradient descent as the number of hidden units $N$ and gradient descent steps grow to infinity. In particular, we…

Machine Learning · Statistics 2022-06-02 Jiahui Yu , Konstantinos Spiliopoulos

Sparse linear models are one of several core tools for interpretable machine learning, a field of emerging importance as predictive models permeate decision-making in many domains. Unfortunately, sparse linear models are far less flexible…

Machine Learning · Statistics 2024-01-03 Ryan Thompson , Amir Dezfouli , Robert Kohn

We introduce an evolving network model in which a new node attaches to a randomly selected target node and also to each of its neighbors with probability $p$. The resulting network is sparse for $p<\frac{1}{2}$ and dense (average degree…

Physics and Society · Physics 2016-11-23 R. Lambiotte , P. L. Krapivsky , U. Bhat , S. Redner

We revisit logistic regression and its nonlinear extensions, including multilayer feedforward neural networks, by showing that these classifiers can be viewed as converting input or higher-level features into Dempster-Shafer mass functions…

Machine Learning · Computer Science 2019-12-13 Thierry Denoeux
‹ Prev 1 3 4 5 6 7 10 Next ›