English
Related papers

Related papers: Feature Pyramid Transformer

200 papers

Low level features like edges and textures play an important role in accurately localizing instances in neural networks. In this paper, we propose an architecture which improves feature pyramid networks commonly used instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Yongqing Sun , Pranav Shenoy K P , Jun Shimamura , Atsushi Sagata

Local features at neighboring spatial positions in feature maps have high correlation since their receptive fields are often overlapped. Self-attention usually uses the weighted sum (or other functions) with internal elements of each local…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Yang Du , Chunfeng Yuan , Bing Li , Lili Zhao , Yangxi Li , Weiming Hu

The paradigm of Transformers using the self-attention mechanism has manifested its advantage in learning graph-structured data. Yet, Graph Transformers are capable of modeling full range dependencies but are often deficient in extracting…

Machine Learning · Computer Science 2024-09-11 Minhong Zhu , Zhenhao Zhao , Weiran Cai

The task of action detection aims at deducing both the action category and localization of the start and end moment for each action instance in a long, untrimmed video. While vision Transformers have driven the recent advances in video…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yuetian Weng , Zizheng Pan , Mingfei Han , Xiaojun Chang , Bohan Zhuang

Feature pyramid network (FPN) is one of the key components for object detectors. However, there is a long-standing puzzle for researchers that the detection performance of large-scale objects are usually suppressed after introducing FPN. To…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zhenchao Jin , Dongdong Yu , Luchuan Song , Zehuan Yuan , Lequan Yu

Semantic segmentation is a challenging problem due to difficulties in modeling context in complex scenes and class confusions along boundaries. Most literature either focuses on context modeling or boundary refinement, which is less…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Fangrui Zhu , Yi Zhu , Li Zhang , Chongruo Wu , Yanwei Fu , Mu Li

Learning multi-scale representations is the common strategy to tackle object scale variation in dense prediction tasks. Although existing feature pyramid networks have greatly advanced visual recognition, inherent design defects inhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Meng'en Qin , Yu Song , Quanling Zhao , Xiaodong Yang , Yingtao Che , Xiaohui Yang

In image fusion, images obtained from different sensors are fused to generate a single image with enhanced information. In recent years, state-of-the-art methods have adopted Convolution Neural Networks (CNNs) to encode meaningful features…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Vibashan VS , Jeya Maria Jose Valanarasu , Poojan Oza , Vishal M. Patel

We study the intrinsic transformation of feature maps across convolutional network layers with explicit top-down control. To this end, we develop top-down feature transformer (TFT), under controllable parameters, that are able to account…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Zhiwei Jia , Haoshen Hong , Siyang Wang , Kwonjoon Lee , Zhuowen Tu

Traffic sign detection is a vital task in the visual system of self-driving cars and the automated driving system. Recently, novel Transformer-based models have achieved encouraging results for various computer vision tasks. We still…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Omid Nejati Manzari , Amin Boudesh , Shahriar B. Shokouhi

We consider the problem of segmentation and classification of high-resolution and hyperspectral remote sensing images. Unlike conventional natural (RGB) images, the inherent large scale and complex structures of remote sensing images pose…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Qingsong Xu , Xin Yuan , Chaojun Ouyang , Yue Zeng

Transformer-based models have transformed the landscape of natural language processing (NLP) and are increasingly applied to computer vision tasks with remarkable success. These models, renowned for their ability to capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Gracile Astlin Pereira , Muhammad Hussain

Robust environment perception for autonomous vehicles is a tremendous challenge, which makes a diverse sensor set with e.g. camera, lidar and radar crucial. In the process of understanding the recorded sensor data, 3D semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Hannah Schieber , Fabian Duerr , Torsten Schoen , Jürgen Beyerer

We present a method to learn a diverse group of object categories from an unordered point set. We propose our Pyramid Point network, which uses a dense pyramid structure instead of the traditional 'U' shape, typically seen in semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Nina Varney , Vijayan K. Asari , Quinn Graehling

Visual feature pyramid has shown its superiority in both effectiveness and efficiency in a wide range of applications. However, the existing methods exorbitantly concentrate on the inter-layer feature interactions but ignore the intra-layer…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yu Quan , Dong Zhang , Liyan Zhang , Jinhui Tang

The ability to detect objects in images at varying scales has played a pivotal role in the design of modern object detectors. Despite considerable progress in removing hand-crafted components and simplifying the architecture with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Duy-Kien Nguyen , Martin R. Oswald , Cees G. M. Snoek

One-shot object detection aims at detecting novel objects according to merely one given instance. With extreme data scarcity, current approaches explore various feature fusions to obtain directly transferable meta-knowledge. Yet, their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yizhou Zhao , Xun Guo , Yan Lu

Current state-of-the-art convolutional architectures for object detection are manually designed. Here we aim to learn a better architecture of feature pyramid network for object detection. We adopt Neural Architecture Search and discover a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Golnaz Ghiasi , Tsung-Yi Lin , Ruoming Pang , Quoc V. Le

The recently proposed MaskFormer gives a refreshed perspective on the task of semantic segmentation: it shifts from the popular pixel-level classification paradigm to a mask-level classification method. In essence, it generates paired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Zipeng Qin , Jianbo Liu , Xiaolin Zhang , Maoqing Tian , Aojun Zhou , Shuai Yi , Hongsheng Li

Recently, the vision transformer has achieved great success by pushing the state-of-the-art of various vision tasks. One of the most challenging problems in the vision transformer is that the large sequence length of image tokens leads to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Yu-Huan Wu , Yun Liu , Xin Zhan , Ming-Ming Cheng