English
Related papers

Related papers: Learning sparse linear dynamic networks in a hyper…

200 papers

Network inference has been extensively studied in several fields, such as systems biology and social sciences. Learning network topology and internal dynamics is essential to understand mechanisms of complex systems. In particular, sparse…

Machine Learning · Statistics 2022-06-13 Yasen Wang , Junyang Jin , Jorge Goncalves

Topology learning of networked dynamical systems is an important problem with implications to optimal control, decision-making over networks, cybersecurity and safety. The majority of prior work in consistent topology estimation relies on…

Optimization and Control · Mathematics 2024-10-15 Harish Doddi , Deepjyoti Deka , Murti Salapaka

Sparse neural networks attract increasing interest as they exhibit comparable performance to their dense counterparts while being computationally efficient. Pruning the dense neural networks is among the most widely used methods to obtain a…

Neural and Evolutionary Computing · Computer Science 2022-11-11 Zahra Atashgahi , Joost Pieterse , Shiwei Liu , Decebal Constantin Mocanu , Raymond Veldhuis , Mykola Pechenizkiy

Maximum likelihood estimation is effective for identifying dynamical systems, but applying it to large networks becomes computationally prohibitive. This paper introduces a maximum likelihood estimation method that enables identification of…

Systems and Control · Electrical Eng. & Systems 2025-11-06 João Victor Galvão da Mata , Anders Hansson , Martin S. Andersen

Learning dynamical systems is a promising avenue for scientific discoveries. However, capturing the governing dynamics in multiple environments still remains a challenge: model-based approaches rely on the fidelity of assumptions made for a…

Machine Learning · Computer Science 2023-03-09 MoonJeong Park , Youngbin Choi , Namhoon Lee , Dongwoo Kim

This paper considers the distributed sparse identification problem over wireless sensor networks such that all sensors cooperatively estimate the unknown sparse parameter vector of stochastic dynamic systems by using the local information…

Systems and Control · Electrical Eng. & Systems 2022-03-08 Die Gan , Zhixin Liu

We analyze the landscape and training dynamics of diagonal linear networks in a linear regression task, with the network parameters being perturbed by small isotropic normal noise. The addition of such noise may be interpreted as a…

Machine Learning · Computer Science 2025-03-18 Gabriel Clara , Sophie Langer , Johannes Schmidt-Hieber

Identification methods for dynamic networks typically require prior knowledge of the network and disturbance topology, and often rely on solving poorly scalable non-convex optimization problems. While methods for estimating network topology…

Systems and Control · Electrical Eng. & Systems 2022-05-26 Stefanie J. M. Fonken , Karthik R. Ramaswamy , Paul M. J. Van den Hof

Inferring network topology from dynamical observations is a fundamental problem pervading research on complex systems. Here, we present a simple, direct method to infer the structural connection topology of a network, given an observation…

Chaotic Dynamics · Physics 2015-05-19 Srinivas Gorur Shandilya , Marc Timme

In this paper, we are interested in learning the underlying graph structure behind training data. Solving this basic problem is essential to carry out any graph signal processing or machine learning task. To realize this, we assume that the…

Machine Learning · Computer Science 2018-05-08 Sundeep Prabhakar Chepuri , Sijia Liu , Geert Leus , Alfred O. Hero

Modeling and identification of high-dimensional stochastic processes is ubiquitous in many fields. In particular, there is a growing interest in modeling stochastic processes with simple and interpretable structures. In many applications,…

Optimization and Control · Mathematics 2016-10-11 Mattia Zorzi , Alessandro Chiuso

We propose Sparse Neural Network architectures that are based on random or structured bipartite graph topologies. Sparse architectures provide compression of the models learned and speed-ups of computations, they can also surpass their…

Machine Learning · Computer Science 2017-06-20 Alfred Bourely , John Patrick Boueri , Krzysztof Choromonski

This paper is concerned about sparse, continuous frequency estimation in line spectral estimation, and focused on developing gridless sparse methods which overcome grid mismatches and correspond to limiting scenarios of existing grid-based…

Information Theory · Computer Science 2023-07-19 Zai Yang , Lihua Xie

In this work, we explore the state-space formulation of a network process to recover, from partial observations, the underlying network topology that drives its dynamics. To do so, we employ subspace techniques borrowed from system…

Signal Processing · Electrical Eng. & Systems 2019-06-26 Mario Coutino , Elvin Isufi , Takanori Maehara , Geert Leus

The topologies of predictable dynamic networks are continuously dynamic in terms of node position, network connectivity and link metric. However, their dynamics are almost predictable compared with the ad-hoc network. The existing routing…

Networking and Internet Architecture · Computer Science 2018-08-20 Zengyin Yang , Qian Wu , Zhize Li , Hewu Li , Jianping Wu

We study the dynamics of an online algorithm for learning a sparse leading eigenvector from samples generated from a spiked covariance model. This algorithm combines the classical Oja's method for online PCA with an element-wise…

Information Theory · Computer Science 2016-09-09 Chuang Wang , Yue M. Lu

In applications of nonlinear and complex dynamical systems, a common situation is that the system can be measured but its structure and the detailed rules of dynamical evolution are unknown. The inverse problem is to determine the system…

Dynamical Systems · Mathematics 2021-09-15 Ying-Cheng Lai

The microscopic and macroscopic dynamics of random networks is investigated in the strong-dilution limit (i.e. for sparse networks). By simulating chaotic maps, Stuart-Landau oscillators, and leaky integrate-and-fire neurons, we show that a…

Disordered Systems and Neural Networks · Physics 2012-12-24 Stefano Luccioli , Simona Olmi , Antonio Politi , Alessandro Torcini

This paper presents new dynamic topology adaptation strategies for distributed estimation in smart grids systems. We propose a dynamic exhaustive search--based topology adaptation algorithm and a dynamic sparsity--inspired topology…

Information Theory · Computer Science 2014-01-16 S. Xu , R. C. de Lamare , H. V. Poor

Reconstructing the equation of motion and thus the network topology of a system from time series is a very important problem. Although many powerful methods have been developed, it remains a great challenge to deal with systems in high…

Adaptation and Self-Organizing Systems · Physics 2023-08-16 Zishuo Yan , Lili Gui , Kun Xu , Yueheng Lan