English
Related papers

Related papers: Semantic Segmentation Enhanced Transformer Model f…

200 papers

Recognizing human actions from untrimmed videos is an important task in activity understanding, and poses unique challenges in modeling long-range temporal relations. Recent works adopt a predict-and-refine strategy which converts an…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Zhichao Liu , Leshan Wang , Desen Zhou , Jian Wang , Songyang Zhang , Yang Bai , Errui Ding , Rui Fan

Semantic segmentation is one of the core tasks in the field of computer vision, and its goal is to accurately classify each pixel in an image. The traditional Unet model achieves efficient feature extraction and fusion through an…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Xuan Li , Quanchao Lu , Yankaiqi Li , Muqing Li , Yijiashun Qi

Visual segmentation seeks to partition images, video frames, or point clouds into multiple segments or groups. This technique has numerous real-world applications, such as autonomous driving, image editing, robot sensing, and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiangtai Li , Henghui Ding , Haobo Yuan , Wenwei Zhang , Jiangmiao Pang , Guangliang Cheng , Kai Chen , Ziwei Liu , Chen Change Loy

Image segmentation is often ambiguous at the level of individual image patches and requires contextual information to reach label consensus. In this paper we introduce Segmenter, a transformer model for semantic segmentation. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Robin Strudel , Ricardo Garcia , Ivan Laptev , Cordelia Schmid

Existing state-of-the-art saliency detection methods heavily rely on CNN-based architectures. Alternatively, we rethink this task from a convolution-free sequence-to-sequence perspective and predict saliency by modeling long-range…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Nian Liu , Ni Zhang , Kaiyuan Wan , Ling Shao , Junwei Han

Vision transformer networks have shown superiority in many computer vision tasks. In this paper, we take a step further by proposing a novel generative vision transformer with latent variables following an informative energy-based prior for…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Jing Zhang , Jianwen Xie , Nick Barnes , Ping Li

Image captioning has been recently gaining a lot of attention thanks to the impressive achievements shown by deep captioning architectures, which combine Convolutional Neural Networks to extract image representations, and Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

Scene recognition is currently one of the top-challenging research fields in computer vision. This may be due to the ambiguity between classes: images of several scene classes may share similar objects, which causes confusion among them.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Álvaro García-Martín

Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Libo Wang , Rui Li , Ce Zhang , Shenghui Fang , Chenxi Duan , Xiaoliang Meng , Peter M. Atkinson

In this paper we introduce a novel Depth-Aware Video Saliency approach to predict human focus of attention when viewing RGBD videos on regular 2D screens. We train a generative convolutional neural network which predicts a saliency map for…

Computer Vision and Pattern Recognition · Computer Science 2016-03-14 G. Leifman , D. Rudoy , T. Swedish , E. Bayro-Corrochano , R. Raskar

Currently, convolutional neural networks (CNN) (e.g., U-Net) have become the de facto standard and attained immense success in medical image segmentation. However, as a downside, CNN based methods are a double-edged sword as they fail to…

Image and Video Processing · Electrical Eng. & Systems 2022-04-01 Reza Azad , Moein Heidari , Yuli Wu , Dorit Merhof

Data-driven saliency detection has attracted strong interest as a result of applying convolutional neural networks to the detection of eye fixations. Although a number of imagebased salient object and fixation detection models have been…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Meijun Sun , Ziqi Zhou , QinGhua Hu , Zheng Wang , Jianmin Jiang

The human visual system employs a selective attention mechanism to understand the visual world in an eficient manner. In this paper, we show how computational models of this mechanism can be exploited for the computer vision application of…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Samuel F. Dodge , Lina J. Karam

Semantic segmentation involves assigning a specific category to each pixel in an image. While Vision Transformer-based models have made significant progress, current semantic segmentation methods often struggle with precise predictions in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Guoan Xu , Wenfeng Huang , Tao Wu , Ligeng Chen , Wenjing Jia , Guangwei Gao , Xiatian Zhu , Stuart Perry

The role of long- and short-term dynamics towards salient object detection in videos is under-researched. We present a Transformer-based approach to learn a joint representation of video frames and past saliency information. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Theodor Wulff , Fares Abawi , Philipp Allgeuer , Stefan Wermter

The Dynamic Saliency Prediction (DSP) task simulates the human selective attention mechanism to perceive the dynamic scene, which is significant and imperative in many vision tasks. Most of existing methods only consider visual cues, while…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Hailong Ning , Bin Zhao , Zhanxuan Hu , Lang He , Ercheng Pei

Multi-task learning has proven to be effective in improving the performance of correlated tasks. Most of the existing methods use a backbone to extract initial features with independent branches for each task, and the exchange of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Diogo Nunes Goncalves , Jose Marcato Junior , Pedro Zamboni , Hemerson Pistori , Jonathan Li , Keiller Nogueira , Wesley Nunes Goncalves

Video saliency prediction and detection are thriving research domains that enable computers to simulate the distribution of visual attention akin to how humans perceiving dynamic scenes. While many approaches have crafted task-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Junwen Xiong , Peng Zhang , Chuanyue Li , Wei Huang , Yufei Zha , Tao You

Semantic segmentation of microscopy cell images by deep learning is a significant technique. We considered that the Transformers, which have recently outperformed CNNs in image recognition, could also be improved and developed for cell…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Hinako Mitsuoka , Kazuhiro Hotta

The last decades have seen great progress in saliency prediction, with the success of deep neural networks that are able to encode high-level semantics. Yet, while humans have the innate capability in leveraging their knowledge to decide…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Yifeng Zhang , Ming Jiang , Qi Zhao