English
Related papers

Related papers: Data-driven inference of hidden nodes in networks

200 papers

Finding interactions between variables in large and high-dimensional datasets is often a serious computational challenge. Most approaches build up interaction sets incrementally, adding variables in a greedy fashion. The drawback is that…

Machine Learning · Statistics 2016-04-27 Rajen Dinesh Shah , Nicolai Meinshausen

Convolutional neural networks (CNNs) have achieved superior accuracy in many visual related tasks. However, the inference process through intermediate layers is opaque, making it difficult to interpret such networks or develop trust in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Yael Konforti , Alon Shpigler , Boaz Lernerand Aharon Bar-Hillel

The availability of empirical data that capture the structure and behavior of complex networked systems has been greatly increased in recent years, however a versatile computational toolbox for unveiling a complex system's nodal and…

Physics and Society · Physics 2022-03-28 Ting-Ting Gao , Gang Yan

Interacting systems are prevalent in nature, from dynamical systems in physics to complex societal dynamics. The interplay of components can give rise to complex behavior, which can often be explained using a simple model of the system's…

Machine Learning · Statistics 2018-06-07 Thomas Kipf , Ethan Fetaya , Kuan-Chieh Wang , Max Welling , Richard Zemel

We investigate the representation of hierarchical models in terms of marginals of other hierarchical models with smaller interactions. We focus on binary variables and marginals of pairwise interaction models whose hidden variables are…

Probability · Mathematics 2016-03-08 Guido Montufar , Johannes Rauh

In todays age of data, discovering relationships between different variables is an interesting and a challenging problem. This problem becomes even more critical with regards to complex dynamical systems like weather forecasting and…

Data Analysis, Statistics and Probability · Physics 2021-02-01 Sachin Kasture

In this paper, we proposed the \textit{link injection}, a novel method that helps any differentiable graph machine learning models to go beyond observed connections from the input data in an end-to-end learning fashion. It finds out (weak)…

Social and Information Networks · Computer Science 2020-09-10 Jie Bu , M. Maruf , Arka Daw

Detecting covert channels among legitimate traffic represents a severe challenge due to the high heterogeneity of networks. Therefore, we propose an effective covert channel detection method, based on the analysis of DNS network data…

Cryptography and Security · Computer Science 2020-10-06 Salvatore Saeli , Federica Bisio , Pierangelo Lombardo , Danilo Massa

Generalized linear models are one of the most efficient paradigms for predicting the correlated stochastic activity of neuronal networks in response to external stimuli, with applications in many brain areas. However, when dealing with…

Disordered Systems and Neural Networks · Physics 2020-11-17 Gabriel Mahuas , Giulio Isacchini , Olivier Marre , Ulisse Ferrari , Thierry Mora

Ising models are a simple generative approach to describing interacting binary variables. They have proven useful in a number of biological settings because they enable one to represent observed many-body correlations as the separable…

Machine Learning · Computer Science 2021-09-10 Emma Slade , Sonya Kiselgof , Lena Granovsky , Jeremy L. England

The study of connectivity and coordination has drawn increasing attention in recent decades due to their central role in driving markets, shaping societal dynamics, and influencing biological systems. Traditionally, observable connections,…

Social and Information Networks · Computer Science 2025-04-04 Shahar Somin , Tom Cohen , Jeremy Kepner , Alex Pentland

Can evolving networks be inferred and modeled without directly observing their nodes and edges? In many applications, the edges of a dynamic network might not be observed, but one can observe the dynamics of stochastic cascading processes…

Machine Learning · Computer Science 2019-02-26 Elahe Ghalebi , Baharan Mirzasoleiman , Radu Grosu , Jure Leskovec

Complex, dynamic networks underlie many systems, and understanding these networks is the concern of a great span of important scientific and engineering problems. Quantitative description is crucial for this understanding yet, due to a…

We propose a novel machine learning approach for inferring causal variables of a target variable from observations. Our focus is on directly inferring a set of causal factors without requiring full causal graph reconstruction, which is…

Machine Learning · Computer Science 2025-10-01 Jang-Hyun Kim , Claudia Skok Gibbs , Sangdoo Yun , Hyun Oh Song , Kyunghyun Cho

Data in the real world often has an evolving distribution. Thus, machine learning models trained on such data get outdated over time. This phenomenon is called model drift. Knowledge of this drift serves two purposes: (i) Retain an accurate…

Machine Learning · Computer Science 2025-03-11 Pranoy Panda , Kancheti Sai Srinivas , Vineeth N Balasubramanian , Gaurav Sinha

The behavior of ecological systems mainly relies on the interactions between the species it involves. We consider the problem of inferring the species interaction network from abundance data. To be relevant, any network inference…

Applications · Statistics 2019-10-29 Raphaëlle Momal , Stéphane Robin , Christophe Ambroise

In order to use the advanced inference techniques available for Ising models, we transform complex data (real vectors) into binary strings, by local averaging and thresholding. This transformation introduces parameters, which must be varied…

Statistical Finance · Quantitative Finance 2015-06-17 Hongli Zeng , Rémi Lemoy , Mikko Alava

Vital node identification is the problem of finding nodes of highest importance in complex networks. This problem has crucial applications in various contexts such as viral marketing or controlling the propagation of virus or rumours in…

Social and Information Networks · Computer Science 2022-02-15 Ahmad Asgharian Rezaei , Justin Munoz , Mahdi Jalili , Hamid Khayyam

Ising models with pairwise interactions are the least structured, or maximum-entropy, probability distributions that exactly reproduce measured pairwise correlations between spins. Here we use this equivalence to construct Ising models that…

Neurons and Cognition · Quantitative Biology 2007-05-23 Gasper Tkacik , Elad Schneidman , Michael J Berry , William Bialek

A deep latent variable model is a powerful method for capturing complex distributions. These models assume that underlying structures, but unobserved, are present within the data. In this dissertation, we explore high-dimensional problems…

Machine Learning · Computer Science 2024-06-13 Khuong Vo