English
Related papers

Related papers: Concept-aware clustering for decentralized deep le…

200 papers

This paper considers a network of sensors without fusion center that may be difficult to set up in applications involving sensors embedded on autonomous drones or robots. In this context, this paper considers that the sensors must perform a…

Statistics Theory · Mathematics 2017-06-13 Dominique Pastor , Elsa Dupraz , François-Xavier Socheleau

Decentralized machine learning is a promising emerging paradigm in view of global challenges of data ownership and privacy. We consider learning of linear classification and regression models, in the setting where the training data is…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-20 Lie He , An Bian , Martin Jaggi

This paper addresses the problem of decentralized learning to achieve a high-performance global model by asking a group of clients to share local models pre-trained with their own data resources. We are particularly interested in a specific…

Machine Learning · Computer Science 2020-08-19 Jiaxin Ma , Ryo Yonetani , Zahid Iqbal

Classical machine learning algorithms often assume that the data are drawn i.i.d. from a stationary probability distribution. Recently, continual learning emerged as a rapidly growing area of machine learning where this assumption is…

Machine Learning · Computer Science 2022-07-12 Timothée Lesort , Massimo Caccia , Irina Rish

In novel class discovery (NCD), we are given labeled data from seen classes and unlabeled data from unseen classes, and we train clustering models for the unseen classes. However, the implicit assumptions behind NCD are still unclear. In…

Machine Learning · Computer Science 2022-09-09 Haoang Chi , Feng Liu , Bo Han , Wenjing Yang , Long Lan , Tongliang Liu , Gang Niu , Mingyuan Zhou , Masashi Sugiyama

Practical applications of artificial intelligence increasingly often have to deal with the streaming properties of real data, which, considering the time factor, are subject to phenomena such as periodicity and more or less chaotic…

Machine Learning · Computer Science 2025-03-05 Joanna Komorniczak , Paweł Ksieniewicz

Can artificial intelligence discover, from raw experience and without human supervision, concepts that humans have discovered? One challenge is that human concepts themselves are fluid: conceptual boundaries can shift, split, and merge as…

Artificial Intelligence · Computer Science 2025-12-24 Zhengmian Hu

Temporal domain generalization is a promising yet extremely challenging area where the goal is to learn models under temporally changing data distributions and generalize to unseen data distributions following the trends of the change. The…

Machine Learning · Computer Science 2023-02-13 Guangji Bai , Chen Ling , Liang Zhao

Continual learning aims to improve the ability of modern learning systems to deal with non-stationary distributions, typically by attempting to learn a series of tasks sequentially. Prior art in the field has largely considered supervised…

Machine Learning · Computer Science 2019-11-01 Dushyant Rao , Francesco Visin , Andrei A. Rusu , Yee Whye Teh , Razvan Pascanu , Raia Hadsell

Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Weijie Chen , Shiliang Pu , Di Xie , Shicai Yang , Yilu Guo , Luojun Lin

Recent advances in decentralized deep learning algorithms have demonstrated cutting-edge performance on various tasks with large pre-trained models. However, a pivotal prerequisite for achieving this level of competitiveness is the…

Machine Learning · Computer Science 2024-04-15 Nastaran Saadati , Minh Pham , Nasla Saleem , Joshua R. Waite , Aditya Balu , Zhanhong Jiang , Chinmay Hegde , Soumik Sarkar

Identifying and understanding dynamic concepts in co-evolving sequences is crucial for analyzing complex systems such as IoT applications, financial markets, and online activity logs. These concepts provide valuable insights into the…

Machine Learning · Computer Science 2024-09-24 Kunpeng Xu , Lifei Chen , Shengrui Wang

Partitioning large networks into stable clusters of synchronized nodes is a challenging task. Recent approaches based on spectral analysis can provide exact results on specific dynamics but remain unfeasible for very large networks.…

Physics and Society · Physics 2026-01-23 Massimo Ostilli

This paper introduces decentralized and modular neural network framework designed to enhance the scalability, interpretability, and performance of artificial intelligence (AI) systems. At the heart of this framework is a dynamic switch…

Neural and Evolutionary Computing · Computer Science 2025-04-28 Surajit Majumder , Paritosh Ranjan , Prodip Roy , Bhuban Padhan

Clustering high-dimensional datasets is hard because interpoint distances become less informative in high-dimensional spaces. We present a clustering algorithm that performs nonlinear dimensionality reduction and clustering jointly. The…

Machine Learning · Computer Science 2018-03-06 Sohil Atul Shah , Vladlen Koltun

The development of online algorithms to track time-varying systems has drawn a lot of attention in the last years, in particular in the framework of online convex optimization. Meanwhile, sparse time-varying optimization has emerged as a…

Optimization and Control · Mathematics 2020-02-03 Sophie M. Fosson

We present a novel approach, in which we learn to cluster data directly from side information, in the form of a small set of pairwise examples. Unlike previous methods, with or without side information, we do not need to know the number of…

Machine Learning · Computer Science 2023-05-31 Michael A. Hobley , Victor A. Prisacariu

In many scientific problems such as video surveillance, modern genomics, and finance, data are often collected from diverse measurements across time that exhibit time-dependent heterogeneous properties. Thus, it is important to not only…

Machine Learning · Statistics 2022-10-10 Lin Qiu , Vernon M. Chinchilli , Lin Lin

We propose a deep amortized clustering (DAC), a neural architecture which learns to cluster datasets efficiently using a few forward passes. DAC implicitly learns what makes a cluster, how to group data points into clusters, and how to…

Machine Learning · Computer Science 2019-10-01 Juho Lee , Yoonho Lee , Yee Whye Teh

The amount of real-time communication between agents in an information system has increased rapidly since the beginning of the decade. This is because the use of these systems, e. g. social media, has become commonplace in today's society.…

Machine Learning · Computer Science 2020-07-13 Christoph Raab , Moritz Heusinger , Frank-Michael Schleif