English
Related papers

Related papers: CTVIS: Consistent Training for Online Video Instan…

200 papers

This paper presents Probabilistic Video Contrastive Learning, a self-supervised representation learning method that bridges contrastive learning with probabilistic representation. We hypothesize that the clips composing the video have…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Jungin Park , Jiyoung Lee , Ig-Jae Kim , Kwanghoon Sohn

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

Recently, memory-based approaches show promising results on semi-supervised video object segmentation. These methods predict object masks frame-by-frame with the help of frequently updated memory of the previous mask. Different from this…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Kwanyong Park , Sanghyun Woo , Seoung Wug Oh , In So Kweon , Joon-Young Lee

Different to semantic segmentation, instance segmentation assigns unique labels to each individual instance of the same class. In this work, we propose a novel recurrent fully convolutional network architecture for tracking such instance…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Christian Payer , Darko Štern , Thomas Neff , Horst Bischof , Martin Urschler

In this work we present a novel solution for Video Instance Segmentation(VIS), that is automatically generating instance level segmentation masks along with object class and tracking them in a video. Our method improves the masks from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Vidit Goel , Jiachen Li , Shubhika Garg , Harsh Maheshwari , Humphrey Shi

This paper studies the problem of semi-supervised video object segmentation(VOS). Multiple works have shown that memory-based approaches can be effective for video object segmentation. They are mostly based on pixel-level matching, both…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Li Hu , Peng Zhang , Bang Zhang , Pan Pan , Yinghui Xu , Rong Jin

Prior work has established Test-Time Training (TTT) as a general framework to further improve a trained model at test time. Before making a prediction on each test instance, the model is first trained on the same instance using a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Renhao Wang , Yu Sun , Arnuv Tandon , Yossi Gandelsman , Xinlei Chen , Alexei A. Efros , Xiaolong Wang

Weakly supervised whole slide image classification is usually formulated as a multiple instance learning (MIL) problem, where each slide is treated as a bag, and the patches cut out of it are treated as instances. Existing methods either…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Linhao Qu , Yingfan Ma , Xiaoyuan Luo , Manning Wang , Zhijian Song

In Video Object Detection (VID), a common practice is to leverage the rich temporal contexts from the video to enhance the object representations in each frame. Existing methods treat the temporal contexts obtained from different objects…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Chaorui Deng , Da Chen , Qi Wu

Class Incremental Semantic Segmentation~(CISS), within Incremental Learning for semantic segmentation, targets segmenting new categories while reducing the catastrophic forgetting on the old categories.Besides, background shifting, where…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Anqi Zhang , Guangyu Gao

In this work, we evaluate contrastive models for the task of image retrieval. We hypothesise that models that are learned to encode semantic similarity among instances via discriminative learning should perform well on the task of image…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Tarun Krishna , Kevin McGuinness , Noel O'Connor

Focusing on only semantic instances that only salient in a scene gains more benefits for robot navigation and self-driving cars than looking at all objects in the whole scene. This paper pushes the envelope on salient regions in a video to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Trung-Nghia Le , Akihiro Sugimoto

Instance segmentation is a computer vision task where separate objects in an image are detected and segmented. State-of-the-art deep neural network models require large amounts of labeled data in order to perform well in this task. Making…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Tuomas Sormunen , Arttu Lämsä , Miguel Bordallo Lopez

Instance segmentation of novel objects instances in RGB images, given some example images for each object, is a well known problem in computer vision. Designing a model general enough to be employed for all kinds of novel objects without…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Max Gandyra , Alessandro Santonicola , Michael Beetz

Online continual learning aims to get closer to a live learning experience by learning directly on a stream of data with temporally shifting distribution and by storing a minimum amount of data from that stream. In this empirical…

Recently, because of the high-quality representations of contrastive learning methods, rehearsal-based contrastive continual learning has been proposed to explore how to continually learn transferable representation embeddings to avoid the…

Machine Learning · Computer Science 2024-03-08 Jiyong Li , Dilshod Azizov , Yang Li , Shangsong Liang

Novelty detection, i.e., identifying whether a given sample is drawn from outside the training distribution, is essential for reliable machine learning. To this end, there have been many attempts at learning a representation well-suited for…

Machine Learning · Computer Science 2020-10-22 Jihoon Tack , Sangwoo Mo , Jongheon Jeong , Jinwoo Shin

We propose a novel implicit feature refinement module for high-quality instance segmentation. Existing image/video instance segmentation methods rely on explicitly stacked convolutions to refine instance features before the final…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Lufan Ma , Tiancai Wang , Bin Dong , Jiangpeng Yan , Xiu Li , Xiangyu Zhang

Audiovisual instance segmentation (AVIS) requires accurately localizing and tracking sounding objects throughout video sequences. Existing methods suffer from visual bias stemming from two fundamental issues: uniform additive fusion…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-30 Jinbae Seo , Hyeongjun Kwon , Kwonyoung Kim , Jiyoung Lee , Kwanghoon Sohn

Understanding human actions from videos plays a critical role across various domains, including sports analytics. In figure skating, accurately recognizing the type and timing of jumps a skater performs is essential for objective…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Ryota Tanaka , Tomohiro Suzuki , Keisuke Fujii