English
Related papers

Related papers: Optimal synchronization on strongly connected dire…

200 papers

While the harmonic function solution performs well in many semi-supervised learning (SSL) tasks, it is known to scale poorly with the number of samples. Recent successful and scalable methods, such as the eigenfunction method focus on…

Machine Learning · Statistics 2016-01-22 Daniele Calandriello , Alessandro Lazaric , Michal Valko , Ioannis Koutis

For compressed sensing over arbitrarily connected networks, we consider the problem of estimating underlying sparse signals in a distributed manner. We introduce a new signal model that helps to describe inter-signal correlation among…

Information Theory · Computer Science 2013-10-29 Dennis Sundman , Saikat Chatterjee , Mikael Skoglund

Post-training Sparsity (PTS) is a recently emerged avenue that chases efficient network sparsity with limited data in need. Existing PTS methods, however, undergo significant performance degradation compared with traditional methods that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jingjing Xie , Yuxin Zhang , Mingbao Lin , Zhihang Lin , Liujuan Cao , Rongrong Ji

We discuss a simple method of constructing correlated random networks, which was recently proposed by M. Bogu~n'a and R. Pastor-Satorras (cond-mat/0306072). The result of this construction procedure is a sparse network whose degree--degree…

Statistical Mechanics · Physics 2007-05-23 S. N. Dorogovtsev

Amplify-and-forward two-way relay network (AFTWRN) was introduced to realize high-data rate transmission over the wireless frequency-selective channel. However, AFTWRC requires the knowledge of channel state information (CSI) not only for…

Information Theory · Computer Science 2013-06-25 Guan Gui , Qun Wan , Wei Peng , Fumiyuki Adachi

We propose a novel extension to symmetrized neural network operators by incorporating fractional and mixed activation functions. This study addresses the limitations of existing models in approximating higher-order smooth functions,…

Machine Learning · Statistics 2025-01-22 Rômulo Damasclin Chaves dos Santos , Jorge Henrique de Oliveira Sales

Many growing networks possess accelerating statistics where the number of links added with each new node is an increasing function of network size so the total number of links increases faster than linearly with network size. In particular,…

Molecular Networks · Quantitative Biology 2017-12-22 M. J. Gagen , J. S. Mattick

Federated learning faces significant challenges in scenarios with heterogeneous data distributions and adverse network conditions, such as delays, packet loss, and data poisoning attacks. This paper proposes a novel method based on the…

Machine Learning · Computer Science 2025-01-28 Mohammad Ghabel Rahmat , Majid Khalilian

Ultra-dense network (UDN) is a promising technology to further evolve wireless networks and meet the diverse performance requirements of 5G networks. With abundant access points, each with communication, computation and storage resources,…

Information Theory · Computer Science 2017-09-27 Yuanming Shi , Jun Zhang , Wei Chen , Khaled B. Letaief

The impact of local reflection symmetry on wave localization and transport within finite disordered chains is investigated. Local symmetries thereby play the role of a spatial correlation of variable range in the finite system. We find…

Disordered Systems and Neural Networks · Physics 2020-08-21 C. V. Morfonios , M. Röntgen , F. K. Diakonos , P. Schmelcher

Distributed training is the de facto standard to scale up the training of deep learning models with multiple GPUs. Its performance bottleneck lies in communications for gradient synchronization. Although high tensor sparsity is widely…

Machine Learning · Computer Science 2024-12-17 Zhuang Wang , Zhaozhuo Xu , Jingyi Xi , Yuke Wang , Anshumali Shrivastava , T. S. Eugene Ng

This letter proposes a dynamic power splitting scheme (DPSS) for decode-and-forward (DF) based cooperative simultaneous wireless information and power transfer (SWIPT) networks with direct link. The relay node adopts an optimal dynamic…

Signal Processing · Electrical Eng. & Systems 2019-02-28 Yingting Liu , Yinghui Ye , Haiyang Ding , Jianmei Shen , Hongwu Yang

Fluid antenna systems (FASs) have introduced a new paradigm for wireless system design by revealing how mutual correlation can be exploited to harvest inherent spatial diversity. While existing studies have mainly focused on one-sided FAS…

Information Theory · Computer Science 2026-04-21 Zhentian Zhang , Yuanhui Wu , Kai-Kit Wong , Hao Jiang , An Li

We present Scaff-PD, a fast and communication-efficient algorithm for distributionally robust federated learning. Our approach improves fairness by optimizing a family of distributionally robust objectives tailored to heterogeneous clients.…

Machine Learning · Computer Science 2023-07-26 Yaodong Yu , Sai Praneeth Karimireddy , Yi Ma , Michael I. Jordan

We provide novel guaranteed approaches for training feedforward neural networks with sparse connectivity. We leverage on the techniques developed previously for learning linear networks and show that they can also be effectively adopted to…

Machine Learning · Computer Science 2015-04-29 Hanie Sedghi , Anima Anandkumar

Recent advances in convolutional neural networks(CNNs) usually come with the expense of excessive computational overhead and memory footprint. Network compression aims to alleviate this issue by training compact models with comparable…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Xin-Yu Zhang , Kai Zhao , Taihong Xiao , Ming-Ming Cheng , Ming-Hsuan Yang

This paper investigates federated learning (FL) in a multi-hop communication setup, such as in constellations with inter-satellite links. In this setup, part of the FL clients are responsible for forwarding other client's results to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Sourav Mukherjee , Nasrin Razmi , Armin Dekorsy , Petar Popovski , Bho Matthiesen

In this paper, we investigate the performance analysis of dual hop relaying system consisting of asymmetric Radio Frequency (RF)/Free Optical Space (FSO) links. The RF channels follow a Rayleigh distribution and the optical links are…

Signal Processing · Electrical Eng. & Systems 2019-01-17 Elyes Balti , Mohsen Guizani , Bechir Hamdaoui , Yassine Maalej

Sparseness is a useful regularizer for learning in a wide range of applications, in particular in neural networks. This paper proposes a model targeted at classification tasks, where sparse activity and sparse connectivity are used to…

Machine Learning · Computer Science 2016-04-19 Markus Thom , Günther Palm

The stability of synchronous states is analysed in the context of two populations of inhibitory and excitatory neurons, characterized by different pulse-widths. The problem is reduced to that of determining the eigenvalues of a suitable…

Neurons and Cognition · Quantitative Biology 2020-02-04 Afifurrahman , Ekkehard Ullner , Antonio Politi