English
Related papers

Related papers: SMART: Semantic Matching Contrastive Learning for …

200 papers

Video semantic segmentation(VSS) has been widely employed in lots of fields, such as simultaneous localization and mapping, autonomous driving and surveillance. Its core challenge is how to leverage temporal information to achieve better…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Zhigang Cen , Ningyan Guo , Wenjing Xu , Zhiyong Feng , Danlan Huang

Clustering with incomplete views is a challenge in multi-view clustering. In this paper, we provide a novel and simple method to address this issue. Specifically, the proposed method simultaneously exploits the local information of each…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Jie Wen , Zheng Zhang , Yong Xu , Zuofeng Zhong

The effectiveness of contrastive learning in sequential recommendation hinges on the construction of contrastive views, which ideally should be both semantically consistent and diverse. However, most existing CL-based methods rely on…

Information Retrieval · Computer Science 2026-05-13 Wei Wang

We propose a unified point cloud video self-supervised learning framework for object-centric and scene-centric data. Previous methods commonly conduct representation learning at the clip or frame level and cannot well capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao , Longguang Wang , Yulan Guo , Hehe Fan

Self-supervised learning is a central component in recent approaches to deep multi-view clustering (MVC). However, we find large variations in the development of self-supervision-based methods for deep MVC, potentially slowing the progress…

Machine Learning · Statistics 2023-03-20 Daniel J. Trosten , Sigurd Løkse , Robert Jenssen , Michael C. Kampffmeyer

Multi-view learning can cover all features of data samples more comprehensively, so multi-view learning has attracted widespread attention. Traditional subspace clustering methods, such as sparse subspace clustering (SSC) and low-ranking…

Machine Learning · Computer Science 2022-01-04 Jian-wei Liu , Hao-jie Xie , Run-kun Lu , Xiong-lin Luo

In the era of big data, it is common to have data with multiple modalities or coming from multiple sources, known as "multi-view data". Multi-view clustering provides a natural way to generate clusters from such data. Since different views…

Machine Learning · Computer Science 2016-11-08 Weixiang Shao , Lifang He , Chun-Ta Lu , Philip S. Yu

Few-Shot learning aims to train and optimize a model that can adapt to unseen visual classes with only a few labeled examples. The existing few-shot learning (FSL) methods, heavily rely only on visual data, thus fail to capture the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Mohamed Afham , Ranga Rodrigo

Multi-relational graph clustering has demonstrated remarkable success in uncovering underlying patterns in complex networks. Representative methods manage to align different views motivated by advances in contrastive learning. Our empirical…

Machine Learning · Computer Science 2024-07-25 Zhixiang Shen , Haolan He , Zhao Kang

Contrastive learning has been successfully used for retrieval of semantically aligned sentences, but it often requires large batch sizes or careful engineering to work well. In this paper, we instead propose a generative model for learning…

Computation and Language · Computer Science 2023-06-06 John Wieting , Jonathan H. Clark , William W. Cohen , Graham Neubig , Taylor Berg-Kirkpatrick

Recent multimodal models such as Contrastive Language-Image Pre-training (CLIP) have shown remarkable ability to align visual and linguistic representations. However, domains where small visual differences carry large semantic significance,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hiroshi Sasaki

Visual Commonsense Reasoning (VCR) remains a significant yet challenging research problem in the realm of visual reasoning. A VCR model generally aims at answering a textual question regarding an image, followed by the rationale prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Zhenyang Li , Yangyang Guo , Kejie Wang , Fan Liu , Liqiang Nie , Mohan Kankanhalli

Semi-supervised semantic segmentation (SSS) has recently gained increasing research interest as it can reduce the requirement for large-scale fully-annotated training data. The current methods often suffer from the confirmation bias from…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zicheng Wang , Zhen Zhao , Xiaoxia Xing , Dong Xu , Xiangyu Kong , Luping Zhou

Multi-view clustering (MVC) optimally integrates complementary information from different views to improve clustering performance. Although demonstrating promising performance in various applications, most of existing approaches directly…

Machine Learning · Computer Science 2022-08-03 Siwei Wang , Xinwang Liu , En Zhu

Self-supervised learning based on instance discrimination has shown remarkable progress. In particular, contrastive learning, which regards each image as well as its augmentations as an individual class and tries to distinguish them from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Haohang Xu , Xiaopeng Zhang , Hao Li , Lingxi Xie , Hongkai Xiong , Qi Tian

The success of existing multi-view clustering (MVC) relies on the assumption that all views are complete. However, samples are usually partially available due to data corruption or sensor malfunction, which raises the research of incomplete…

Machine Learning · Computer Science 2023-09-01 Yi Wen , Siwei Wang , Ke Liang , Weixuan Liang , Xinhang Wan , Xinwang Liu , Suyuan Liu , Jiyuan Liu , En Zhu

Incomplete multi-view clustering (IMVC) is an unsupervised approach, among which IMVC via contrastive learning has received attention due to its excellent performance. The previous methods have the following problems: 1) Over-reliance on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Kaiwu Zhang , Shiqiang Du , Baokai Liu , Shengxia Gao

While contrastive multi-view clustering has achieved remarkable success, it implicitly assumes balanced class distribution. However, real-world multi-view data primarily exhibits class imbalance distribution. Consequently, existing methods…

Machine Learning · Computer Science 2025-06-17 Xuqian Xue , Yiming Lei , Qi Cai , Hongming Shan , Junping Zhang

Recent work shows that documents from encyclopedias serve as helpful auxiliary information for zero-shot learning. Existing methods align the entire semantics of a document with corresponding images to transfer knowledge. However, they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Xiangyan Qu , Jing Yu , Keke Gai , Jiamin Zhuang , Yuanmin Tang , Gang Xiong , Gaopeng Gou , Qi Wu

Incomplete multi-view clustering (IMVC) aims to cluster multi-view data that are only partially available. This poses two main challenges: effectively leveraging multi-view information and mitigating the impact of missing views. Prevailing…

Machine Learning · Computer Science 2024-07-15 Ge Teng , Ting Mao , Chen Shen , Xiang Tian , Xuesong Liu , Yaowu Chen , Jieping Ye