English
Related papers

Related papers: Deep Multimodal Clustering for Unsupervised Audiov…

200 papers

Unsupervised video class incremental learning (uVCIL) represents an important learning paradigm for learning video information without forgetting, and without considering any data labels. Prior approaches have focused on supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Nattapong Kurpukdee , Adrian G. Bors

Recently, deep clustering (DPCL) based speaker-independent speech separation has drawn much attention, since it needs little speaker prior information. However, it still has much room of improvement, particularly in reverberant…

Sound · Computer Science 2019-10-25 Ziye Yang , Xiao-Lei Zhang

There has been an explosion of multimodal content generated on social media networks in the last few years, which has necessitated a deeper understanding of social media content and user behavior. We present a novel content-independent…

Information Retrieval · Computer Science 2019-06-12 Karan Sikka , Lucas Van Bramer , Ajay Divakaran

Deep clustering as an important branch of unsupervised representation learning focuses on embedding semantically similar samples into the identical feature space. This core demand inspires the exploration of contrastive learning and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haifeng Xia , Hai Huang , Zhengming Ding

The communication of scientific knowledge has become increasingly multimodal, spanning text, visuals, and speech through materials such as research papers, slides, and recorded presentations. These different representations collectively…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Megha Mariam K. M , Vineeth N. Balasubramanian , C. V. Jawahar

Clustering artworks is difficult for several reasons. On the one hand, recognizing meaningful patterns in accordance with domain knowledge and visual perception is extremely difficult. On the other hand, applying traditional clustering and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Giovanna Castellano , Gennaro Vessio

Subspace clustering is a classical technique that has been widely used for human motion segmentation and other related tasks. However, existing segmentation methods often cluster data without guidance from prior knowledge, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Tao Zhou , Huazhu Fu , Chen Gong , Ling Shao , Fatih Porikli , Haibin Ling , Jianbing Shen

Humans have an incredible ability to process and understand information from multiple sources such as images, video, text, and speech. Recent success of deep neural networks has enabled us to develop algorithms which give machines the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Dheeraj Peri , Shagan Sah , Raymond Ptucha

Learning by integrating multiple heterogeneous data sources is a common requirement in many tasks. Collective Matrix Factorization (CMF) is a technique to learn shared latent representations from arbitrary collections of matrices. It can be…

Machine Learning · Computer Science 2021-09-29 Ragunathan Mariappan , Vaibhav Rajan

This paper introduces a novel methodology of adapting the representation of videos based on the dynamics of their scene content variation. In particular, we demonstrate how the clustering of dynamic mode decomposition eigenvalues can be…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Owen T. Huber , Raghu G. Raj , Tianyu Chen , Zacharie I. Idriss

Multi-view clustering has attracted broad attention due to its capacity to utilize consistent and complementary information among views. Although tremendous progress has been made recently, most existing methods undergo high complexity,…

Machine Learning · Computer Science 2023-06-28 Xinhang Wan , Jiyuan Liu , Xinwang Liu , Siwei Wang , Yi Wen , Tianjiao Wan , Li Shen , En Zhu

Clustering is widely used in unsupervised learning method that deals with unlabeled data. Deep clustering has become a popular study area that relates clustering with Deep Neural Network (DNN) architecture. Deep clustering method…

Machine Learning · Computer Science 2020-07-14 Abu Quwsar Ohi , M. F. Mridha , Farisa Benta Safir , Md. Abdul Hamid , Muhammad Mostafa Monowar

The increasing availability and diversity of multimodal data in recommender systems offer new avenues for enhancing recommendation accuracy and user satisfaction. However, these systems must contend with high-dimensional, sparse user-item…

Information Retrieval · Computer Science 2024-12-04 Yasser Khalafaoui , Martino Lovisetto , Basarab Matei , Nistor Grozavu

Recently, significant progress has been made in multi-modal continual learning, aiming to learn new tasks sequentially in multi-modal settings while preserving performance on previously learned ones. However, existing methods mainly focus…

Multimedia · Computer Science 2026-03-10 Yuyang Hong , Qi Yang , Tao Zhang , Zili Wang , Zhaojin Fu , Kun Ding , Bin Fan , Shiming Xiang

Tractography fiber clustering using diffusion MRI (dMRI) is a crucial strategy for white matter (WM) parcellation. Current methods primarily use the geometric information of fibers (i.e., the spatial trajectories) to group similar fibers…

Image and Video Processing · Electrical Eng. & Systems 2024-12-17 Jin Wang , Bocheng Guo , Yijie Li , Junyi Wang , Yuqian Chen , Jarrett Rushmore , Nikos Makris , Yogesh Rathi , Lauren J O'Donnell , Fan Zhang

Learning dense visual representations without labels is an arduous task and more so from scene-centric data. We propose to tackle this challenging problem by proposing a Cross-view consistency objective with an Online Clustering mechanism…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Thomas Stegmüller , Tim Lebailly , Behzad Bozorgtabar , Tinne Tuytelaars , Jean-Philippe Thiran

In this paper, we focus on unsupervised representation learning for clustering of images. Recent advances in deep clustering and unsupervised representation learning are based on the idea that different views of an input image (generated…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Aniket Anand Deshmukh , Jayanth Reddy Regatti , Eren Manavoglu , Urun Dogan

Humans possess a remarkable ability to integrate auditory and visual information, enabling a deeper understanding of the surrounding environment. This early fusion of audio and visual cues, demonstrated through cognitive psychology and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shentong Mo , Pedro Morgado

Multi-modal learning, particularly among imaging and linguistic modalities, has made amazing strides in many high-level fundamental visual understanding problems, ranging from language grounding to dense event captioning. However, much of…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 Tanzila Rahman , Bicheng Xu , Leonid Sigal

Multimodal learning from document data has achieved great success lately as it allows to pre-train semantically meaningful features as a prior into a learnable downstream task. In this paper, we approach the document classification problem…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Souhail Bakkali , Zuheng Ming , Mickael Coustaty , Marçal Rusiñol , Oriol Ramos Terrades