English
Related papers

Related papers: Multi-Modal Unsupervised Pre-Training for Surgical…

200 papers

Current state-of-the-art classification and detection algorithms rely on supervised training. In this work we study unsupervised feature learning in the context of temporally coherent video data. We focus on feature learning from unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2015-09-09 Ross Goroshin , Joan Bruna , Jonathan Tompson , David Eigen , Yann LeCun

Self-supervised tasks have been utilized to build useful representations that can be used in downstream tasks when the annotation is unavailable. In this paper, we introduce a self-supervised video representation learning method based on…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Duc Quang Vu , Ngan T. H. Le , Jia-Ching Wang

Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 András Kalapos , Bálint Gyires-Tóth

In this work, we propose a new unsupervised image segmentation approach based on mutual information maximization between different constructed views of the inputs. Taking inspiration from autoregressive generative models that predict the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Yassine Ouali , Céline Hudelot , Myriam Tami

We present a novel approach for unsupervised activity segmentation which uses video frame clustering as a pretext task and simultaneously performs representation learning and online clustering. This is in contrast with prior works where…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sateesh Kumar , Sanjay Haresh , Awais Ahmed , Andrey Konin , M. Zeeshan Zia , Quoc-Huy Tran

Understanding the workflow of surgical procedures in complex operating rooms requires a deep understanding of the interactions between clinicians and their environment. Surgical activity recognition (SAR) is a key computer vision task that…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Idris Hamoud , Vinkle Srivastav , Muhammad Abdullah Jamal , Didier Mutter , Omid Mohareri , Nicolas Padoy

Semi-supervised learning (SSL) has attracted much attention since it reduces the expensive costs of collecting adequate well-labeled training data, especially for deep learning methods. However, traditional SSL is built upon an assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Lie Ju , Yicheng Wu , Wei Feng , Zhen Yu , Lin Wang , Zhuoting Zhu , Zongyuan Ge

Semi-supervised learning has made significant strides in the medical domain since it alleviates the heavy burden of collecting abundant pixel-wise annotated data for semantic segmentation tasks. Existing semi-supervised approaches enhance…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Xu Zheng , Chong Fu , Haoyu Xie , Jialei Chen , Xingwei Wang , Chiu-Wing Sham

Scaling up weakly-supervised datasets has shown to be highly effective in the image-text domain and has contributed to most of the recent state-of-the-art computer vision and multimodal neural networks. However, existing large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Vladislav Lialin , Stephen Rawls , David Chan , Shalini Ghosh , Anna Rumshisky , Wael Hamza

Unpaired Multi-Modal Learning (UMML) which leverages unpaired multi-modal data to boost model performance on each individual modality has attracted a lot of research interests in medical image analysis. However, existing UMML methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Lei Zhu , Yanyu Xu , Huazhu Fu , Xinxing Xu , Rick Siow Mong Goh , Yong Liu

This thesis works to address a pivotal challenge in medical image analysis: the reliance on extensive labeled datasets, which are often limited due to the need for expert annotation and constrained by privacy and legal issues. By focusing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Cristian Simionescu

Reducing the quantity of annotations required for supervised training is vital when labels are scarce and costly. This reduction is especially important for semantic segmentation tasks involving 3D datasets that are often significantly…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Andrej Janda , Brandon Wagstaff , Edwin G. Ng , Jonathan Kelly

Multi-Modal Self-Supervised Learning from videos has been shown to improve model's performance on various downstream tasks. However, such Self-Supervised pre-training requires large batch sizes and a large amount of computation resources…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Duo Wang , Salah Karout

Federated learning aims to tackle the ``isolated data island" problem, where it trains a collective model from physically isolated clients while safeguarding the privacy of users' data. However, supervised federated learning necessitates…

Artificial Intelligence · Computer Science 2024-04-18 Hao Yan , Yuhong Guo

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

As digital medical imaging becomes more prevalent and archives increase in size, representation learning exposes an interesting opportunity for enhanced medical decision support systems. On the other hand, medical imaging data is often…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Eduardo Pinho , Carlos Costa

The goal of this paper is to self-train a 3D convolutional neural network on an unlabeled video collection for deployment on small-scale video collections. As smaller video datasets benefit more from motion than appearance, we strive to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Kirill Gavrilyuk , Mihir Jain , Ilia Karmanov , Cees G. M. Snoek

Unsupervised domain adaptation (UDA) has been a potent technique to handle the lack of annotations in the target domain, particularly in semantic segmentation task. This study introduces a different UDA scenarios where the target domain…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Fei Pan , Xu Yin , Seokju Lee , Axi Niu , Sungeui Yoon , In So Kweon

We address the problem of extracting key steps from unlabeled procedural videos, motivated by the potential of Augmented Reality (AR) headsets to revolutionize job training and performance. We decompose the problem into two steps:…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Anshul Shah , Benjamin Lundell , Harpreet Sawhney , Rama Chellappa

We consider the task of multimodal one-shot speech-image matching. An agent is shown a picture along with a spoken word describing the object in the picture, e.g. cookie, broccoli and ice-cream. After observing one paired speech-image…

Computation and Language · Computer Science 2020-08-17 Leanne Nortje , Herman Kamper