English
Related papers

Related papers: Multi-Task Self-Training for Learning General Repr…

200 papers

Continual learning aims to improve the ability of modern learning systems to deal with non-stationary distributions, typically by attempting to learn a series of tasks sequentially. Prior art in the field has largely considered supervised…

Machine Learning · Computer Science 2019-11-01 Dushyant Rao , Francesco Visin , Andrei A. Rusu , Yee Whye Teh , Razvan Pascanu , Raia Hadsell

We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts. The network learns to extract…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Baptiste Angles , Yuhe Jin , Simon Kornblith , Andrea Tagliasacchi , Kwang Moo Yi

Multi-view subspace clustering aims to divide a set of multisource data into several groups according to their underlying subspace structure. Although the spectral clustering based methods achieve promotion in multi-view clustering, their…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Songsong Wu , Zhiqiang Lu , Hao Tang , Yan Yan , Songhao Zhu , Xiao-Yuan Jing , Zuoyong Li

Affective Behavior Analysis is an important part in human-computer interaction. Existing multi-task affective behavior recognition methods suffer from the problem of incomplete labeled datasets. To tackle this problem, this paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Lingfeng Wang , Shisen Wang , Jin Qi , Kenji Suzuki

Unsupervised representation learning has significantly advanced various machine learning tasks. In the computer vision domain, state-of-the-art approaches utilize transformations like random crop and color jitter to achieve invariant…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Jaemyung Yu , Jaehyun Choi , Dong-Jae Lee , HyeongGwon Hong , Junmo Kim

Deep learning models usually require sufficient training data to achieve high accuracy, but obtaining labeled data can be time-consuming and labor-intensive. Here we introduce a template-based training method to train a 3D U-Net model from…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Fang-Cheng Yeh

Robot picking and packing tasks require dexterous manipulation skills, such as rearranging objects to establish a good grasping pose, or placing and pushing items to achieve tight packing. These tasks are challenging for robots due to the…

Robotics · Computer Science 2025-02-06 Kai Gao , Fan Wang , Erica Aduh , Dylan Randle , Jane Shi

In practical applications, computer vision tasks often need to be addressed simultaneously. Multitask learning typically achieves this by jointly training a single deep neural network to learn shared representations, providing efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Konstantinos Spathis , Nikolaos Kardaris , Petros Maragos

Unsupervised person re-identification (re-ID) has become an important topic due to its potential to resolve the scalability problem of supervised re-ID models. However, existing methods simply utilize pseudo labels from clustering for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Junhui Yin , Jiayan Qiu , Siqing Zhang , Jiyang Xie , Zhanyu Ma , Jun Guo

This work investigates the unexplored usability of self-supervised representation learning in the direction of functional knowledge transfer. In this work, functional knowledge transfer is achieved by joint optimization of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Prakash Chandra Chhipa , Muskaan Chopra , Gopal Mengi , Varun Gupta , Richa Upadhyay , Meenakshi Subhash Chippa , Kanjar De , Rajkumar Saini , Seiichi Uchida , Marcus Liwicki

The long-term goal of machine learning is to learn general visual representations from a small amount of data without supervision, mimicking three advantages of human cognition: i) no need for labels, ii) robustness to data scarcity, and…

Machine Learning · Computer Science 2023-08-29 Jingyao Wang , Zeen Song , Wenwen Qiang , Changwen Zheng

Self-supervised learning aims to learn representations from the data itself without explicit manual supervision. Existing efforts ignore a crucial aspect of self-supervised learning - the ability to scale to large amount of data because…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Priya Goyal , Dhruv Mahajan , Abhinav Gupta , Ishan Misra

Deep learning-based models, when trained in a fully-supervised manner, can be effective in performing complex image analysis tasks, although contingent upon the availability of large labeled datasets. Especially in the medical imaging…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Ayaan Haque , Abdullah-Al-Zubaer Imran , Adam Wang , Demetri Terzopoulos

Self-training is a simple semi-supervised learning approach: Unlabelled examples that attract high-confidence predictions are labelled with their predictions and added to the training set, with this process being repeated multiple times.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

Learning meaningful representations is at the heart of many tasks in the field of modern machine learning. Recently, a lot of methods were introduced that allow learning of image representations without supervision. These representations…

Self-supervised learning is popular method because of its ability to learn features in images without using its labels and is able to overcome limited labeled datasets used in supervised learning. Self-supervised learning works by using a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Aristo Renaldo Ruslim , Novanto Yudistira , Budi Darma Setiawan

Weakly supervised video anomaly detection (WS-VAD) is to distinguish anomalies from normal events based on discriminative representations. Most existing works are limited in insufficient video representations. In this work, we develop a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Jia-Chang Feng , Fa-Ting Hong , Wei-Shi Zheng

Learning with few labeled tabular samples is often an essential requirement for industrial machine learning applications as varieties of tabular data suffer from high annotation costs or have difficulties in collecting new samples for novel…

Machine Learning · Computer Science 2023-03-03 Jaehyun Nam , Jihoon Tack , Kyungmin Lee , Hankook Lee , Jinwoo Shin

We consider a new problem of few-shot learning of compact models. Meta-learning is a popular approach for few-shot learning. Previous work in meta-learning typically assumes that the model architecture during meta-training is the same as…

Machine Learning · Computer Science 2022-10-19 Yong Wu , Shekhor Chanda , Mehrdad Hosseinzadeh , Zhi Liu , Yang Wang

Many self-supervised learning methods are pre-trained on the well-curated ImageNet-1K dataset. In this work, given the excellent scalability of web data, we consider self-supervised pre-training on noisy web sourced image-text paired data.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Bingchen Zhao , Quan Cui , Hao Wu , Osamu Yoshie , Cheng Yang , Oisin Mac Aodha