English
Related papers

Related papers: WegFormer: Transformers for Weakly Supervised Sema…

200 papers

The combination of audio and vision has long been a topic of interest in the multi-modal community. Recently, a new audio-visual segmentation (AVS) task has been introduced, aiming to locate and segment the sounding objects in a given…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Shengyi Gao , Zhe Chen , Guo Chen , Wenhai Wang , Tong Lu

While CNNs were long considered state of the art for image processing, the introduction of Transformer architectures has challenged this position. While achieving excellent results in image classification and segmentation, Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 DeShin Hwa , Tobias Holmes , Klaus Drechsler

Referring image segmentation aims to segment the target referent in an image conditioning on a natural language expression. Existing one-stage methods employ per-pixel classification frameworks, which attempt straightforwardly to align…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jiajin Tang , Ge Zheng , Cheng Shi , Sibei Yang

Deep learning techniques have achieved remarkable success in the semantic segmentation of remote sensing images and in land-use change detection. Nevertheless, their real-time deployment on edge platforms remains constrained by decoder…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Sihang Chen , Lijun Yun , Ze Liu , JianFeng Zhu , Jie Chen , Hui Wang , Yueping Nie

Unmanned aerial vehicles (UAVs) are frequently used for inspecting power lines and capturing high-resolution aerial images. However, detecting power lines in aerial images is difficult,as the foreground data(i.e, power lines) is small and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Deyu An , Qiang Zhang , Jianshu Chao , Ting Li , Feng Qiao , Yong Deng , Zhenpeng Bian

Transformers have recently achieved state-of-the-art performance in speech separation. These models, however, are computationally demanding and require a lot of learnable parameters. This paper explores Transformer-based speech separation…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Luca Della Libera , Cem Subakan , Mirco Ravanelli , Samuele Cornell , Frédéric Lepoutre , François Grondin

Most existing methods for depth estimation from a focal stack of images employ convolutional neural networks (CNNs) using 2D or 3D convolutions over a fixed set of images. However, their effectiveness is constrained by the local properties…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Xueyang Kang , Fengze Han , Abdur R. Fayjie , Patrick Vandewalle , Kourosh Khoshelham , Dong Gong

Weakly-supervised semantic segmentation (WSSS) performs pixel-wise classification given only image-level labels for training. Despite the difficulty of this task, the research community has achieved promising results over the last five…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Cheolhyun Mun , Sanghuk Lee , Youngjung Uh , Junsuk Choe , Hyeran Byun

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

We explore options to use Transformer networks in neural transducer for end-to-end speech recognition. Transformer networks use self-attention for sequence modeling and comes with advantages in parallel computation and capturing contexts.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-30 Ching-Feng Yeh , Jay Mahadeokar , Kaustubh Kalgaonkar , Yongqiang Wang , Duc Le , Mahaveer Jain , Kjell Schubert , Christian Fuegen , Michael L. Seltzer

Weakly supervised semantic segmentation (WSSS) aims to bypass the need for laborious pixel-level annotation by using only image-level annotation. Most existing methods rely on Class Activation Maps (CAM) to derive pixel-level pseudo-labels…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Tianle Chen , Zheda Mai , Ruiwen Li , Wei-lun Chao

Image denoising is an important low-level computer vision task, which aims to reconstruct a noise-free and high-quality image from a noisy image. With the development of deep learning, convolutional neural network (CNN) has been gradually…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Chao Yao , Shuo Jin , Meiqin Liu , Xiaojuan Ban

The fully convolutional network (FCN) has dominated salient object detection for a long period. However, the locality of CNN requires the model deep enough to have a global receptive field and such a deep model always leads to the loss of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Sucheng Ren , Qiang Wen , Nanxuan Zhao , Guoqiang Han , Shengfeng He

In this paper, we propose a weakly supervised semantic segmentation approach for food images which takes advantage of the zero-shot capabilities and promptability of the Segment Anything Model (SAM) along with the attention mechanisms of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Ioannis Sarafis , Alexandros Papadopoulos , Anastasios Delopoulos

Most recent transformer-based models show impressive performance on vision tasks, even better than Convolution Neural Networks (CNN). In this work, we present a novel, flexible, and effective transformer-based model for high-quality…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Ruohao Guo , Dantong Niu , Liao Qu , Zhenbo Li

Vision Transformers (ViT)s have recently become popular due to their outstanding modeling capabilities, in particular for capturing long-range information, and scalability to dataset and model sizes which has led to state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Ali Hatamizadeh , Ziyue Xu , Dong Yang , Wenqi Li , Holger Roth , Daguang Xu

In this paper, we propose a novel network named Vision Transformer for Biomedical Image Segmentation (ViTBIS). Our network splits the input feature maps into three parts with $1\times 1$, $3\times 3$ and $5\times 5$ convolutions in both…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Abhinav Sagar

Vision transformers have shown excellent performance in computer vision tasks. As the computation cost of their self-attention mechanism is expensive, recent works tried to replace the self-attention mechanism in vision transformers with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Zimian Wei , Hengyue Pan , Lujun Li , Menglong Lu , Xin Niu , Peijie Dong , Dongsheng Li

Pixel-level annotations are expensive and time consuming to obtain. Hence, weak supervision using only image tags could have a significant impact in semantic segmentation. Recently, CNN-based methods have proposed to fine-tune pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Fatemehsadat Saleh , Mohammad Sadegh Ali Akbarian , Mathieu Salzmann , Lars Petersson , Stephen Gould , Jose M. Alvarez

While transformers demonstrate outstanding performance across various audio tasks, their application to neural vocoders remains challenging. Neural vocoders require the generation of long audio signals at the sample level, which demands…

Sound · Computer Science 2025-12-30 Seongho Hong , Yong-Hoon Choi