English
Related papers

Related papers: Temporal-consistent CAMs for Weakly Supervised Vid…

200 papers

Segmenting objects in videos is a fundamental computer vision task. The current deep learning based paradigm offers a powerful, but data-hungry solution. However, current datasets are limited by the cost and human effort of annotating…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Bin Zhao , Goutam Bhat , Martin Danelljan , Luc Van Gool , Radu Timofte

For semantic segmentation, most existing real-time deep models trained with each frame independently may produce inconsistent results for a video sequence. Advanced methods take into considerations the correlations in the video sequence,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yifan Liu , Chunhua Shen , Changqian Yu , Jingdong Wang

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

Weakly supervised semantic segmentation (WSSS) aims at learning a semantic segmentation model with only image-level tags. Despite intensive research on deep learning approaches over a decade, there is still a significant performance gap…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Qi Lai , Chi-Man Vong

Visual saliency, which predicts regions in the field of view that draw the most visual attention, has attracted a lot of interest from researchers. It has already been used in several vision tasks, e.g., image classification, object…

Computer Vision and Pattern Recognition · Computer Science 2015-03-25 Qiang Zhang , Yilin Wang , Baoxin Li

Weakly supervised semantic segmentation (WSSS), which aims to mine the object regions by merely using class-level labels, is a challenging task in computer vision. The current state-of-the-art CNN-based methods usually adopt…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Dongjian Huo , Yukun Su , Qingyao Wu

Learning descriptive spatio-temporal object models from data is paramount for the task of semi-supervised video object segmentation. Most existing approaches mainly rely on models that estimate the segmentation mask based on a reference…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Sergi Caelles , Albert Pumarola , Francesc Moreno-Noguer , Alberto Sanfeliu , Luc Van Gool

The pixel-wise dense prediction tasks based on weakly supervisions currently use Class Attention Maps (CAM) to generate pseudo masks as ground-truth. However, the existing methods typically depend on the painstaking training modules, which…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Yanpeng Sun , Zechao Li

Weakly supervised video anomaly detection (WS-VAD) is a challenging problem that aims to learn VAD models only with video-level annotations. In this work, we propose a Long-Short Temporal Co-teaching (LSTC) method to address the WS-VAD…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Shengyang Sun , Xiaojin Gong

We propose an approach to discover class-specific pixels for the weakly-supervised semantic segmentation task. We show that properly combining saliency and attention maps allows us to obtain reliable cues capable of significantly boosting…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Arslan Chaudhry , Puneet K. Dokania , Philip H. S. Torr

Action detection and temporal segmentation of actions in videos are topics of increasing interest. While fully supervised systems have gained much attention lately, full annotation of each action within the video is costly and impractical…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Alexander Richard , Hilde Kuehne , Juergen Gall

The performance of Video Instance Segmentation (VIS) methods has improved significantly with the advent of transformer networks. However, these networks often face challenges in training due to the high annotation cost. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Farnoosh Arefi , Amir M. Mansourian , Shohreh Kasaei

The Segmentation Anything Model 2 (SAM2) has proven to be a powerful foundation model for promptable visual object segmentation in both images and videos, capable of storing object-aware memories and transferring them temporally through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Syed Hesham Syed Ariff , Yun Liu , Guolei Sun , Jing Yang , Henghui Ding , Xue Geng , Xudong Jiang

Existing studies in weakly supervised semantic segmentation (WSSS) have utilized class activation maps (CAMs) to localize the class objects. However, since a classification loss is insufficient for providing precise object regions, CAMs…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Sung-Hoon Yoon , Hyeokjun Kweon , Jaeseok Jeong , Hyeonseong Kim , Shinjeong Kim , Kuk-Jin Yoon

Segmenting and recognizing diverse object parts is crucial in computer vision and robotics. Despite significant progress in object segmentation, part-level segmentation remains underexplored due to complex boundaries and scarce annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinjian Wu , Ruisong Zhang , Jie Qin , Shijie Ma , Cheng-Lin Liu

This paper proposes a deep learning model to efficiently detect salient regions in videos. It addresses two important issues: (1) deep video saliency model training with the absence of sufficiently large and pixel-wise annotated video data,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Wenguan Wang , Jianbing Shen , Ling Shao

Since the wide employment of deep learning frameworks in video salient object detection, the accuracy of the recent approaches has made stunning progress. These approaches mainly adopt the sequential modules, based on optical flow or…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yi Tang , Yuanman Li , Wenbin Zou

Weakly-supervised semantic segmentation (WSSS) is introduced to narrow the gap for semantic segmentation performance from pixel-level supervision to image-level supervision. Most advanced approaches are based on class activation maps (CAMs)…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Sanghyun Jo , In-Jae Yu

In this work we propose a capsule-based approach for semi-supervised video object segmentation. Current video object segmentation methods are frame-based and often require optical flow to capture temporal consistency across frames which can…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Kevin Duarte , Yogesh S Rawat , Mubarak Shah

The audio-visual segmentation (AVS) task aims to segment sounding objects from a given video. Existing works mainly focus on fusing audio and visual features of a given video to achieve sounding object masks. However, we observed that prior…

Sound · Computer Science 2023-08-02 Chen Liu , Peike Li , Xingqun Qi , Hu Zhang , Lincheng Li , Dadong Wang , Xin Yu