English
Related papers

Related papers: Creating Something from Nothing: Unsupervised Know…

200 papers

Neural machine translation~(NMT) is ineffective for zero-resource languages. Recent works exploring the possibility of unsupervised neural machine translation (UNMT) with only monolingual data can achieve promising results. However, there…

Computation and Language · Computer Science 2021-04-02 Mingxuan Wang , Hongxiao Bai , Hai Zhao , Lei Li

The outpouring of various pre-trained models empowers knowledge distillation by providing abundant teacher resources, but there lacks a developed mechanism to utilize these teachers adequately. With a massive model repository composed of…

Machine Learning · Computer Science 2022-09-29 Su Lu , Han-Jia Ye , De-Chuan Zhan

Due to the availability of large-scale multi-modal data (e.g., satellite images acquired by different sensors, text sentences, etc) archives, the development of cross-modal retrieval systems that can search and retrieve semantically…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Georgii Mikriukov , Mahdyar Ravanbakhsh , Begüm Demir

Knowledge Distillation (KD) has been validated as an effective model compression technique for learning compact object detectors. Existing state-of-the-art KD methods for object detection are mostly based on feature imitation. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jiabao Wang , Yuming Chen , Zhaohui Zheng , Xiang Li , Ming-Ming Cheng , Qibin Hou

Crossmodal knowledge distillation (KD) aims to enhance a unimodal student using a multimodal teacher model. In particular, when the teacher's modalities include the student's, additional complementary information can be exploited to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Chenqi Guo , Mengshuo Rong , Qianli Feng , Rongfan Feng , Yinglong Ma

Data-driven approaches to assist operating room (OR) workflow analysis depend on large curated datasets that are time consuming and expensive to collect. On the other hand, we see a recent paradigm shift from supervised learning to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Muhammad Abdullah Jamal , Omid Mohareri

Unsupervised semantic segmentation aims to discover groupings within and across images that capture object and view-invariance of a category without external supervision. Grouping naturally has levels of granularity, creating ambiguity in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Tsung-Wei Ke , Jyh-Jing Hwang , Yunhui Guo , Xudong Wang , Stella X. Yu

Unsupervised cross-domain person re-identification (Re-ID) aims to adapt the information from the labelled source domain to an unlabelled target domain. Due to the lack of supervision in the target domain, it is crucial to identify the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Xinyu Zhang , Dong Gong , Jiewei Cao , Chunhua Shen

Hashing has been widely applied to multimodal retrieval on large-scale multimedia data due to its efficiency in computation and storage. In this article, we propose a novel deep semantic multimodal hashing network (DSMHN) for scalable…

Computer Vision and Pattern Recognition · Computer Science 2022-01-06 Lu Jin , Zechao Li , Jinhui Tang

The success of supervised learning requires large-scale ground truth labels which are very expensive, time-consuming, or may need special skills to annotate. To address this issue, many self- or un-supervised methods are developed. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Longlong Jing , Yucheng Chen , Ling Zhang , Mingyi He , Yingli Tian

Semi-supervised learning is a challenging problem which aims to construct a model by learning from limited labeled examples. Numerous methods for this task focus on utilizing the predictions of unlabeled instances consistency alone to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Peng Tu , Yawen Huang , Feng Zheng , Zhenyu He , Liujun Cao , Ling Shao

Recent progress on unsupervised learning of cross-lingual embeddings in bilingual setting has given impetus to learning a shared embedding space for several languages without any supervision. A popular framework to solve the latter problem…

Computation and Language · Computer Science 2020-04-21 Pratik Jawanpuria , Mayank Meghwanshi , Bamdev Mishra

Cross-modal hashing (CMH) has appeared as a popular technique for cross-modal retrieval due to its low storage cost and high computational efficiency in large-scale data. Most existing methods implicitly assume that multi-modal data is…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Ruitao Pu , Yuan Sun , Yang Qin , Zhenwen Ren , Xiaomin Song , Huiming Zheng , Dezhong Peng

We propose a training scheme to train neural network-based source separation algorithms from scratch when parallel clean data is unavailable. In particular, we demonstrate that an unsupervised spatial clustering algorithm is sufficient to…

Machine Learning · Computer Science 2019-04-03 Lukas Drude , Daniel Hasenklever , Reinhold Haeb-Umbach

Unsupervised semantic hashing has emerged as an indispensable technique for fast image search, which aims to convert images into binary hash codes without relying on labels. Recent advancements in the field demonstrate that employing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Liyang He , Zhenya Huang , Jiayu Liu , Enhong Chen , Fei Wang , Jing Sha , Shijin Wang

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng

Multimodal supervision has achieved promising results in many visual language understanding tasks, where the language plays an essential role as a hint or context for recognizing and locating instances. However, due to the defects of the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Weixin Feng , Xingyuan Bu , Chenchen Zhang , Xubin Li

Large language models (LLMs) serve as giant information stores, often including personal or copyrighted data, and retraining them from scratch is not a viable option. This has led to the development of various fast, approximate unlearning…

Computation and Language · Computer Science 2024-10-18 Minseok Choi , ChaeHun Park , Dohyun Lee , Jaegul Choo

Multi-modal hashing methods are widely used in multimedia retrieval, which can fuse multi-source data to generate binary hash code. However, the individual backbone networks have limited feature expression capabilities and are not jointly…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Jian Zhu , Mingkai Sheng , Zhangmin Huang , Jingfei Chang , Jinling Jiang , Jian Long , Cheng Luo , Lei Liu

Recently, transfer subspace learning based approaches have shown to be a valid alternative to unsupervised subspace clustering and temporal data clustering for human motion segmentation (HMS). These approaches leverage prior knowledge from…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Mariella Dimiccoli , Lluís Garrido , Guillem Rodriguez-Corominas , Herwig Wendt