English
Related papers

Related papers: Higher Dimensional Consensus: Learning in Large-Sc…

200 papers

The curse of dimensionality presents a pervasive challenge in optimization problems, with exponential expansion of the search space rapidly causing traditional algorithms to become inefficient or infeasible. An adaptive sampling strategy is…

Numerical Analysis · Mathematics 2025-11-18 Julian Soltes

This paper addresses the clustering of data in the hyperdimensional computing (HDC) domain. In prior work, an HDC-based clustering framework, referred to as HDCluster, has been proposed. However, the performance of the existing HDCluster is…

Machine Learning · Computer Science 2024-04-19 Lulu Ge , Keshab K. Parhi

In a sensor network, in practice, the communication among sensors is subject to:(1) errors or failures at random times; (3) costs; and(2) constraints since sensors and networks operate under scarce resources, such as power, data rate, or…

Information Theory · Computer Science 2009-11-13 Soummya Kar , Jose M. F. Moura

In many modern data sets, High dimension low sample size (HDLSS) data is prevalent in many fields of studies. There has been an increased focus recently on using machine learning and statistical methods to mine valuable information out of…

Optimization and Control · Mathematics 2023-05-23 Srivathsan Amruth , Xin Yee Lam

In this paper, we address the problem of simultaneous classification and estimation of hidden parameters in a sensor network with communications constraints. In particular, we consider a network of noisy sensors which measure a common…

Multiagent Systems · Computer Science 2012-06-19 Fabio Fagnani , Sophie M. Fosson , Chiara Ravazzi

We present HyperSeg, a hyperdimensional computing (HDC) approach to unsupervised dialogue topic segmentation. HDC is a class of vector symbolic architectures that leverages the probabilistic orthogonality of randomly drawn vectors at…

Computation and Language · Computer Science 2023-08-22 Seongmin Park , Jinkyu Seo , Jihwa Lee

We consider estimation under scenarios where the signals of interest exhibit change of characteristics over time. In particular, we consider the continual learning problem where different tasks, e.g., data with different distributions,…

Machine Learning · Computer Science 2023-12-05 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

We design a low complexity decentralized learning algorithm to train a recently proposed large neural network in distributed processing nodes (workers). We assume the communication network between the workers is synchronized and can be…

Machine Learning · Computer Science 2020-09-30 Xinyue Liang , Alireza M. Javid , Mikael Skoglund , Saikat Chatterjee

Dense prediction tasks typically employ encoder-decoder architectures, but the prevalent convolutions in the decoder are not image-adaptive and can lead to boundary artifacts. Different generalized convolution operations have been…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Anne S. Wannenwetsch , Martin Kiefel , Peter V. Gehler , Stefan Roth

This paper addresses weight optimization problem in distributed consensus averaging algorithm over networks with symmetric star topology. We have determined optimal weights and convergence rate of the network in terms of its topological…

Information Theory · Computer Science 2011-07-29 Saber Jafarizadeh , Abbas Jamalipour

Agreement among a set of processes and in the presence of partial failures is one of the fundamental problems of distributed systems. In the most general case, many decisions must be agreed upon over the lifetime of a system with…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-01 Seif Haridi , Lars Kroll , Paris Carbone

In this paper, we study the relationship between resilience and accuracy in the resilient distributed multi-dimensional consensus problem. We consider a network of agents, each of which has a state in $\mathbb{R}^d$. Some agents in the…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Waseem Abbas , Mudassir Shabbir , Jiani Li , Xenofon Koutsoukos

We consider the problem of distributed dictionary learning, where a set of nodes is required to collectively learn a common dictionary from noisy measurements. This approach may be useful in several contexts including sensor networks.…

Machine Learning · Statistics 2013-04-15 Pierre Chainais , Cédric Richard

The problem of decentralized detection in a sensor network subjected to a total average power constraint and all nodes sharing a common bandwidth is investigated. The bandwidth constraint is taken into account by assuming non-orthogonal…

Information Theory · Computer Science 2007-07-13 Sudharman K. Jayaweera

We consider the problem of multi-task learning in the high dimensional setting. In particular, we introduce an estimator and investigate its statistical and computational properties for the problem of multiple connected linear regressions…

Machine Learning · Statistics 2023-07-03 Amir Asiaee , Samet Oymak , Kevin R. Coombes , Arindam Banerjee

We develop cloud-assisted remote sensing techniques for enabling distributed consensus estimation of unknown parameters in a given geographic area. We first propose a distributed sensor network virtualization algorithm that searches for,…

Networking and Internet Architecture · Computer Science 2015-01-16 Sherif Abdelwahab , Bechir Hamdaoui , Mohsen Guizani

Biological organisms must learn how to control their own bodies to achieve deliberate locomotion, that is, predict their next body position based on their current position and selected action. Such learning is goal-agnostic with respect to…

Neural and Evolutionary Computing · Computer Science 2023-04-11 Nathan McDonald

A distributed average consensus algorithm in which every sensor transmits with bounded peak power is proposed. In the presence of communication noise, it is shown that the nodes reach consensus asymptotically to a finite random variable…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-15 Sivaraman Dasarathan , Cihan Tepedelenlioglu , Mahesh Banavar , Andreas Spanias

Multilayer networks provide a more comprehensive framework for exploring real-world and engineering systems than traditional single-layer networks, consisting of multiple interacting networks. However, despite significant research in…

Optimization and Control · Mathematics 2024-11-12 C. D. Rodríguez-Camargo , A. F. Urquijo-Rodríguez , E. A. Mojica-Nava

With the rapid evolution of the Internet of Things, many real-world applications utilize heterogeneously connected sensors to capture time-series information. Edge-based machine learning (ML) methodologies are often employed to analyze…

Machine Learning · Computer Science 2023-08-21 Junyao Wang , Luke Chen , Mohammad Abdullah Al Faruque