English
Related papers

Related papers: Sparse dynamic network reconstruction through L1-r…

200 papers

Networks are widely used in many fields for their powerful ability to provide vivid representations of relationships between variables. However, many of them may be corrupted by experimental noise or inappropriate network inference methods…

Molecular Networks · Quantitative Biology 2021-09-21 Jiating Yu , Jiacheng Leng , Ling-Yun Wu

Recurrent Neural Networks (RNNs) are popular models of brain function. The typical training strategy is to adjust their input-output behavior so that it matches that of the biological circuit of interest. Even though this strategy ensures…

Neurons and Cognition · Quantitative Biology 2020-11-09 Alessandro Salatiello , Martin A. Giese

Network scientists often use complex dynamic processes to describe network contagions, but tools for fitting contagion models typically assume simple dynamics. Here, we address this gap by developing a nonparametric method to reconstruct a…

Social and Information Networks · Computer Science 2024-10-10 Nicholas W. Landry , William Thompson , Laurent Hébert-Dufresne , Jean-Gabriel Young

Reconstructing a network of dynamic systems from observational data is an active area of research. Many approaches guarantee a consistent reconstruction under the relatively strong assumption that the network dynamics is governed by…

Systems and Control · Electrical Eng. & Systems 2020-11-12 Mihaela Dimovska , Donatello Materassi

The couplings in a sparse asymmetric, asynchronous Ising network are reconstructed using an exact learning algorithm. L$_1$ regularization is used to remove the spurious weak connections that would otherwise be found by simply minimizing…

Methodology · Statistics 2012-11-19 Hong-Li Zeng , John Hertz , Yasser Roudi

This paper considers a noisy data structure recovery problem. The goal is to investigate the following question: Given a noisy observation of a permuted data set, according to which permutation was the original data sorted? The focus is on…

Information Theory · Computer Science 2020-11-24 Minoh Jeong , Alex Dytso , Martina Cardone , H. Vincent Poor

We propose and analyze an online algorithm for reconstructing a sequence of signals from a limited number of linear measurements. The signals are assumed sparse, with unknown support, and evolve over time according to a generic nonlinear…

Optimization and Control · Mathematics 2015-03-12 Joao F. C. Mota , Nikos Deligiannis , Aswin C. Sankaranarayanan , Volkan Cevher , Miguel R. D. Rodrigues

In this article the problem of reconstructing the pattern of connection between agents from partial empirical data in a macro-economic model is addressed, given a set of behavioral equations. This systemic point of view puts the focus on…

General Economics · Economics 2019-01-30 Aurélien Hazan

This article investigates the use of a model-based neural-network for the traffic reconstruction problem using noisy measurements coming from probe vehicles. The traffic state is assumed to be the density only, modeled by a partial…

Optimization and Control · Mathematics 2020-11-18 John Liu , Matthieu Barreau , Mladen Cicic , Karl H. Johansson

We present a computational algebra solution to reverse engineering the network structure of discrete dynamical systems from data. We use monomial ideals to determine dependencies between variables that encode constraints on the possible…

Quantitative Methods · Quantitative Biology 2022-12-07 Heather A. Harrington , Mike Stillman , Alan Veliz-Cuba

The network reconstruction task aims to estimate a complex system's structure from various data sources such as time series, snapshots, or interaction counts. Recent work has examined this problem in networks whose relationships involve…

Social and Information Networks · Computer Science 2023-12-05 Simon Lizotte , Jean-Gabriel Young , Antoine Allard

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

Recent advances in convolutional neural networks(CNNs) usually come with the expense of excessive computational overhead and memory footprint. Network compression aims to alleviate this issue by training compact models with comparable…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Xin-Yu Zhang , Kai Zhao , Taihong Xiao , Ming-Ming Cheng , Ming-Hsuan Yang

We propose a systematic method for constructing a sparse data reconstruction algorithm in compressed sensing at a relatively low computational cost for general observation matrix. It is known that the cost of l1-norm minimization using a…

Information Theory · Computer Science 2014-04-10 Koujin Takeda , Yoshiyuki Kabashima

The problem of reconstructing nonlinear and complex dynamical systems from measured data or time series is central to many scientific disciplines including physical, biological, computer, and social sciences, as well as engineering and…

Data Analysis, Statistics and Probability · Physics 2017-05-01 Wenxu Wang , Ying-Cheng Lai , Celso Grebogi

A resource exchange network is considered, where exchanges among nodes are based on reciprocity. Peers receive from the network an amount of resources commensurate with their contribution. We assume the network is fully connected, and…

Social and Information Networks · Computer Science 2018-12-27 Konstantinos P. Tsoukatos

The pseudo-likelihood method is one of the most popular algorithms for learning sparse binary pairwise Markov networks. In this paper, we formulate the $L_1$ regularized pseudo-likelihood problem as a sparse multiple logistic regression…

Machine Learning · Statistics 2017-04-10 Sinong Geng , Zhaobin Kuang , David Page

This paper proposes a balancing-based model reduction approach for an interconnection of passive dynamic subsystems. This approach preserves the passivity and stability of both the subsystems and the interconnected system. Hereto, one…

Systems and Control · Electrical Eng. & Systems 2023-11-23 Luuk Poort , Bart Besselink , Rob H. B. Fey , Nathan van de Wouw

We present a novel network pruning algorithm called Dynamic Sparse Training that can jointly find the optimal network parameters and sparse network structure in a unified optimization process with trainable pruning thresholds. These…

Machine Learning · Computer Science 2020-05-15 Junjie Liu , Zhe Xu , Runbin Shi , Ray C. C. Cheung , Hayden K. H. So

Training a sparse neural network from scratch requires optimizing connections at the same time as the weights themselves. Typically, the weights are redistributed after a predefined number of weight updates, removing a fraction of the…

Machine Learning · Computer Science 2022-11-04 Mathias Parger , Alexander Ertl , Paul Eibensteiner , Joerg H. Mueller , Martin Winter , Markus Steinberger