English
Related papers

Related papers: Multimodal Interaction Modeling via Self-Supervise…

200 papers

Learning algorithms normally assume that there is at most one annotation or label per data point. However, in some scenarios, such as medical diagnosis and on-line collaboration,multiple annotations may be available. In either case,…

Machine Learning · Computer Science 2012-03-19 Yan Yan , Romer Rosales , Glenn Fung , Jennifer Dy

Self-training is an effective approach to semi-supervised learning. The key idea is to let the learner itself iteratively generate "pseudo-supervision" for unlabeled instances based on its current hypothesis. In combination with consistency…

Machine Learning · Statistics 2021-11-05 Julian Lienen , Eyke Hüllermeier

Adaptive machine learning (ML) aims to allow ML models to adapt to ever-changing environments with potential concept drift after model deployment. Traditionally, adaptive ML requires a new dataset to be manually labeled to tailor deployed…

Machine Learning · Computer Science 2024-04-10 Yutian Ren , Aaron Haohua Yen , G. P. Li

Many real-world problems exhibit the coexistence of multiple types of heterogeneity, such as view heterogeneity (i.e., multi-view property) and task heterogeneity (i.e., multi-task property). For example, in an image classification problem…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Lecheng Zheng , Yu Cheng , Jingrui He

Through solving pretext tasks, self-supervised learning leverages unlabeled data to extract useful latent representations replacing traditional input features in the downstream task. In audio/speech signal processing, a wide range of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Salah Zaiem , Titouan Parcollet , Slim Essid , Abdel Heba

Labeling a large set of data is expensive. Active learning aims to tackle this problem by asking to annotate only the most informative data from the unlabeled set. We propose a novel active learning approach that utilizes self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 John Seon Keun Yi , Minseok Seo , Jongchan Park , Dong-Geol Choi

Multi-label classification is a common supervised machine learning problem where each instance is associated with multiple classes. The key challenge in this problem is learning the correlations between the classes. An additional challenge…

Machine Learning · Computer Science 2016-04-05 Divya Padmanabhan , Satyanath Bhat , Shirish Shevade , Y. Narahari

This paper presents a novel approach to Single-Positive Multi-label Learning. In general multi-label learning, a model learns to predict multiple labels or categories for a single input image. This is in contrast with standard multi-class…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Xin Xing , Zhexiao Xiong , Abby Stylianou , Srikumar Sastry , Liyu Gong , Nathan Jacobs

This work describes a self-supervised data augmentation approach used to improve learning models' performances when only a moderate amount of labeled data is available. Multiple copies of the original model are initially trained on the…

Computation and Language · Computer Science 2020-12-18 Gabriele Sarti

The major challenge of learning from multi-label data has arisen from the overwhelming size of label space which makes this problem NP-hard. This problem can be alleviated by gradually involving easy to hard tags into the learning process.…

Machine Learning · Computer Science 2019-10-09 Seyed Amjad Seyedi , S. Siamak Ghodsi , Fardin Akhlaghian , Mahdi Jalili , Parham Moradi

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Multimodal representation learning is fundamentally about transforming incomparable modalities into comparable representations. While prior research primarily focused on explicitly aligning these representations through targeted learning…

Machine Learning · Computer Science 2025-06-16 Megan Tjandrasuwita , Chanakya Ekbote , Liu Ziyin , Paul Pu Liang

Multi-label classification is a widely encountered problem in daily life, where an instance can be associated with multiple classes. In theory, this is a supervised learning method that requires a large amount of labeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 XIn Zhang , Yuqi Song , Fei Zuo , Xiaofeng Wang

Survival analysis stands as a pivotal process in cancer treatment research, crucial for predicting patient survival rates accurately. Recent advancements in data collection techniques have paved the way for enhancing survival predictions by…

Machine Learning · Computer Science 2024-07-26 Linhao Qu , Dan Huang , Shaoting Zhang , Xiaosong Wang

The primary challenge of multi-label active learning, differing it from multi-class active learning, lies in assessing the informativeness of an indefinite number of labels while also accounting for the inherited label correlation. Existing…

Machine Learning · Computer Science 2025-09-05 Yuanyuan Qi , Jueqing Lu , Xiaohao Yang , Joanne Enticott , Lan Du

Precisely naming the action depicted in a video can be a challenging and oftentimes ambiguous task. In contrast to object instances represented as nouns (e.g. dog, cat, chair, etc.), in the case of actions, human annotators typically lack a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Kiyoon Kim , Davide Moltisanti , Oisin Mac Aodha , Laura Sevilla-Lara

Computer-aided diagnosis systems must make critical decisions from medical images that are often noisy, ambiguous, or conflicting, yet today's models are trained on overly simplistic labels that ignore diagnostic uncertainty. One-hot labels…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Ang Nan Gu , Michael Tsang , Hooman Vaseli , Purang Abolmaesumi , Teresa Tsang

Surgical AI often involves multiple tasks within a single procedure, like phase recognition or assessing the Critical View of Safety in laparoscopic cholecystectomy. Traditional models, built for one task at a time, lack flexibility,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Soham Walimbe , Britty Baby , Vinkle Srivastav , Nicolas Padoy

Multi-task learning is central to many real-world applications. Unfortunately, obtaining labelled data for all tasks is time-consuming, challenging, and expensive. Active Learning (AL) can be used to reduce this burden. Existing techniques…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Nikita Durasov , Nik Dorndorf , Pascal Fua

Establishing dense correspondences across semantically similar images remains a challenging task due to the significant intra-class variations and background clutters. Traditionally, a supervised learning was used for training the models,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Jiwon Kim , Kwangrok Ryoo , Junyoung Seo , Gyuseong Lee , Daehwan Kim , Hansang Cho , Seungryong Kim