English
Related papers

Related papers: Lifelong Spectral Clustering

200 papers

In lifelong learning, data are used to improve performance not only on the present task, but also on past and future (unencountered) tasks. While typical transfer learning algorithms can improve performance on future tasks, their…

The Multi-Task Learning (MTL) technique has been widely studied by word-wide researchers. The majority of current MTL studies adopt the hard parameter sharing structure, where hard layers tend to learn general representations over all tasks…

Information Retrieval · Computer Science 2021-01-25 Dehong Gao , Wenjing Yang , Huiling Zhou , Yi Wei , Yi Hu , Hao Wang

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. However, since current works tend to assume exclusivity or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Sijia Wang , Yoojin Choi , Junya Chen , Mostafa El-Khamy , Ricardo Henao

In this paper, we focus on a long-term continual learning (CL) task, where a model learns sequentially from a stream of vast tasks over time, acquiring new knowledge while retaining previously learned information in a manner akin to human…

Machine Learning · Computer Science 2025-05-16 Tianyu Huai , Jie Zhou , Yuxuan Cai , Qin Chen , Wen Wu , Xingjiao Wu , Xipeng Qiu , Liang He

Spectral clustering is a popular method for community detection in network graphs: starting from a matrix representation of the graph, the nodes are clustered on a low dimensional projection obtained from a truncated spectral decomposition…

Machine Learning · Statistics 2022-08-10 Francesco Sanna Passino , Nicholas A. Heard , Patrick Rubin-Delanchy

Recently, a number of works have studied clustering strategies that combine classical clustering algorithms and deep learning methods. These approaches follow either a sequential way, where a deep representation is learned using a deep…

Machine Learning · Computer Science 2019-06-13 Severine Affeldt , Lazhar Labiod , Mohamed Nadif

The clustering methods have recently absorbed even-increasing attention in learning and vision. Deep clustering combines embedding and clustering together to obtain optimal embedding subspace for clustering, which can be more effective…

Machine Learning · Computer Science 2019-05-01 Xu Yang , Cheng Deng , Feng Zheng , Junchi Yan , Wei Liu

Lifelong learning aims to train a model with good performance for new tasks while retaining the capacity of previous tasks. However, some practical scenarios require the system to forget undesirable knowledge due to privacy issues, which is…

Artificial Intelligence · Computer Science 2024-05-30 Lianlei Shan , Wenzhang Zhou , Wei Li , Xingyu Ding

A hallmark of human intelligence is the ability to construct self-contained chunks of knowledge and reuse them in novel combinations for solving different problems. Learning such compositional structures has been a challenge for artificial…

Machine Learning · Computer Science 2022-07-26 Jorge A. Mendez

A hallmark of human intelligence is the ability to construct self-contained chunks of knowledge and adequately reuse them in novel combinations for solving different yet structurally related problems. Learning such compositional structures…

Machine Learning · Computer Science 2021-03-18 Jorge A. Mendez , Eric Eaton

Spectral clustering is a powerful technique for clustering high-dimensional data, utilizing graph-based representations to detect complex, non-linear structures and non-convex clusters. The construction of a similarity graph is essential…

Machine Learning · Computer Science 2025-01-27 Kamal Berahmand , Farid Saberi-Movahed , Razieh Sheikhpour , Yuefeng Li , Mahdi Jalili

The state-of-the-art online learning approaches are only capable of learning the metric for predefined tasks. In this paper, we consider lifelong learning problem to mimic "human learning", i.e., endowing a new capability to the learned…

Machine Learning · Computer Science 2017-06-13 Gan Sun , Yang Cong , Ji Liu , Xiaowei Xu

Spectral clustering has found extensive use in many areas. Most traditional spectral clustering algorithms work in three separate steps: similarity graph construction; continuous labels learning; discretizing the learned labels by k-means…

Machine Learning · Computer Science 2017-11-15 Zhao Kang , Chong Peng , Qiang Cheng , Zenglin Xu

Adapting to task changes without forgetting previous knowledge is a key skill for intelligent systems, and a crucial aspect of lifelong learning. Swarm controllers, however, are typically designed for specific tasks, lacking the ability to…

Neural and Evolutionary Computing · Computer Science 2025-03-25 Lorenzo Leuzzi , Simon Jones , Sabine Hauert , Davide Bacciu , Andrea Cossu

Spectral clustering is a powerful unsupervised machine learning algorithm for clustering data with non convex or nested structures. With roots in graph theory, it uses the spectral properties of the Laplacian matrix to project the data in a…

Quantum Physics · Physics 2021-06-15 Iordanis Kerenidis , Jonas Landman

Clustering is a fundamental unsupervised representation learning task with wide application in computer vision and pattern recognition. Deep clustering utilizes deep neural networks to learn latent representation, which is suitable for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Wenhao Wu , Weiwei Wang , Shengjiang Kong

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Continual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new task without largely forgetting previously…

Computation and Language · Computer Science 2021-01-11 Magdalena Biesialska , Katarzyna Biesialska , Marta R. Costa-jussà

Lifelong machine learning is a novel machine learning paradigm which can continually accumulate knowledge during learning. The knowledge extracting and reusing abilities enable the lifelong machine learning to solve the related problems.…

Computation and Language · Computer Science 2019-06-03 Xianbin Hong , Gautam Pal , Sheng-Uei Guan , Prudence Wong , Dawei Liu , Ka Lok Man , Xin Huang

In this work we present a clustering technique called \textit{multi-level conformal clustering (MLCC)}. The technique is hierarchical in nature because it can be performed at multiple significance levels which yields greater insight into…

Machine Learning · Statistics 2020-06-25 Ilia Nouretdinov , James Gammerman , Matteo Fontana , Daljit Rehal