English
Related papers

Related papers: SOTR: Segmenting Objects with Transformers

200 papers

The objective of this paper is a model that is able to discover, track and segment multiple moving objects in a video. We make four contributions: First, we introduce an object-centric segmentation model with a depth-ordered layer…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Junyu Xie , Weidi Xie , Andrew Zisserman

In this paper, we propose an end-to-end framework for instance segmentation. Based on the recently introduced DETR [1], our method, termed SOLQ, segments objects by learning unified queries. In SOLQ, each query represents one object and has…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Bin Dong , Fangao Zeng , Tiancai Wang , Xiangyu Zhang , Yichen Wei

Instance segmentation is a core computer vision task with great practical significance. Recent advances, driven by large-scale benchmark datasets, have yielded good general-purpose Convolutional Neural Network (CNN)-based methods. Natural…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Przemyslaw Polewski , Jacquelyn Shelton , Wei Yao , Marco Heurich

The perception of moving objects is crucial for autonomous robots performing collision avoidance in dynamic environments. LiDARs and cameras tremendously enhance scene interpretation but do not provide direct motion information and face…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Matthias Zeller , Vardeep S. Sandhu , Benedikt Mersch , Jens Behley , Michael Heidingsfeld , Cyrill Stachniss

Following the successful application of vision transformers in multiple computer vision tasks, these models have drawn the attention of the signal processing community. This is because signals are often represented as spectrograms (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Nicolae-Catalin Ristea , Radu Tudor Ionescu , Fahad Shahbaz Khan

Transformers have become the dominant model in natural language processing, owing to their ability to pretrain on massive amounts of data, then transfer to smaller, more specific tasks via fine-tuning. The Vision Transformer was the first…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Josh Beal , Eric Kim , Eric Tzeng , Dong Huk Park , Andrew Zhai , Dmitry Kislyuk

Transformer models are not only successful in natural language processing (NLP) but also demonstrate high potential in computer vision (CV). Despite great advance, most of works only focus on improvement of architectures but pay little…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Jiangtao Xie , Ruiren Zeng , Qilong Wang , Ziqi Zhou , Peihua Li

We propose a light-weight and highly efficient Joint Detection and Tracking pipeline for the task of Multi-Object Tracking using a fully-transformer architecture. It is a modified version of TransTrack, which overcomes the computational…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Siddharth Sagar Nijhawan , Leo Hoshikawa , Atsushi Irie , Masakazu Yoshimura , Junji Otsuka , Takeshi Ohashi

The attributes of object contours has great significance for instance segmentation task. However, most of the current popular deep neural networks do not pay much attention to the object edge information. Inspired by the human annotation…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Wenchao Zhang , Chong Fu , Mai Zhu

We present a new table structure recognition (TSR) approach, called TSRFormer, to robustly recognizing the structures of complex tables with geometrical distortions from various table images. Unlike previous methods, we formulate table…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Weihong Lin , Zheng Sun , Chixiang Ma , Mingze Li , Jiawei Wang , Lei Sun , Qiang Huo

In this paper, we propose PolyTransform, a novel instance segmentation algorithm that produces precise, geometry-preserving masks by combining the strengths of prevailing segmentation approaches and modern polygon-based methods. In…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Justin Liang , Namdar Homayounfar , Wei-Chiu Ma , Yuwen Xiong , Rui Hu , Raquel Urtasun

Few-shot segmentation aims to train a segmentation model that can fast adapt to novel classes with few exemplars. The conventional training paradigm is to learn to make predictions on query images conditioned on the features from support…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Gengwei Zhang , Guoliang Kang , Yi Yang , Yunchao Wei

The astounding performance of transformers in natural language processing (NLP) has motivated researchers to explore their applications in computer vision tasks. DEtection TRansformer (DETR) introduces transformers to object detection tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Tahira Shehzadi , Khurram Azeem Hashmi , Didier Stricker , Muhammad Zeshan Afzal

Self-supervised Object Segmentation (SOS) aims to segment objects without any annotations. Under conditions of multi-camera inputs, the structural, textural and geometrical consistency among each view can be leveraged to achieve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Xiaoyun Zheng , Liwei Liao , Jianbo Jiao , Feng Gao , Ronggang Wang

Most existing methods realize 3D instance segmentation by extending those models used for 3D object detection or 3D semantic segmentation. However, these non-straightforward methods suffer from two drawbacks: 1) Imprecise bounding boxes or…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Jiahao Sun , Chunmei Qing , Junpeng Tan , Xiangmin Xu

One of the bottlenecks for instance segmentation today lies in the conflicting requirements of high-resolution inputs and lightweight, real-time inference. To address this bottleneck, we present a Polygon Detection Transformer (Poly-DETR)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Jiacheng Sun , Jiaqi Lin , Wenlong Hu , Haoyang Li , Xinghong Zhou , Chenghai Mao , Yan Peng , Xiaomao Li

DEtection TRansformer (DETR) started a trend that uses a group of learnable queries for unified visual perception. This work begins by applying this appealing paradigm to LiDAR-based point cloud segmentation and obtains a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zeqi Xiao , Wenwei Zhang , Tai Wang , Chen Change Loy , Dahua Lin , Jiangmiao Pang

Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Libo Wang , Rui Li , Ce Zhang , Shenghui Fang , Chenxi Duan , Xiaoliang Meng , Peter M. Atkinson

Although convolutional neural networks (CNNs) have achieved remarkable progress in weakly supervised semantic segmentation (WSSS), the effective receptive field of CNN is insufficient to capture global context information, leading to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Chunmeng Liu , Enze Xie , Wenjia Wang , Wenhai Wang , Guangyao Li , Ping Luo

The hybrid architecture of convolutional neural networks (CNNs) and Transformer are very popular for medical image segmentation. However, it suffers from two challenges. First, although a CNNs branch can capture the local image features…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Tao Lei , Rui Sun , Xuan Wang , Yingbo Wang , Xi He , Asoke Nandi