English
Related papers

Related papers: Patcher: Patch Transformers with Mixture of Expert…

200 papers

Automatic medical image segmentation, an essential component of medical image analysis, plays an importantrole in computer-aided diagnosis. For example, locating and segmenting the liver can be very helpful in livercancer diagnosis and…

Image and Video Processing · Electrical Eng. & Systems 2019-10-28 Xi Fang , Bo Du , Sheng Xu , Bradford J. Wood , Pingkun Yan

To build a cross-modal latent space between 3D human motion and language, acquiring large-scale and high-quality human motion data is crucial. However, unlike the abundance of image data, the scarcity of motion data has limited the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Qing Yu , Mikihiro Tanaka , Kent Fujiwara

Recent transformer-based architectures have shown impressive results in the field of image segmentation. Thanks to their flexibility, they obtain outstanding performance in multiple segmentation tasks, such as semantic and panoptic, under a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Niccolò Cavagnero , Gabriele Rosi , Claudia Cuttano , Francesca Pistilli , Marco Ciccone , Giuseppe Averta , Fabio Cermelli

In medical image segmentation, specialized computer vision techniques, notably transformers grounded in attention mechanisms and residual networks employing skip connections, have been instrumental in advancing performance. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Fuchen Zheng , Xuhang Chen , Weihuang Liu , Haolun Li , Yingtie Lei , Jiahui He , Chi-Man Pun , Shounjun Zhou

Most approaches for semantic segmentation use only information from color cameras to parse the scenes, yet recent advancements show that using depth data allows to further improve performances. In this work, we focus on transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Francesco Barbato , Giulia Rizzoli , Pietro Zanuttigh

Transformer is a new kind of neural architecture which encodes the input data as powerful features via the attention mechanism. Basically, the visual transformers first divide the input images into several local patches and then calculate…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Kai Han , An Xiao , Enhua Wu , Jianyuan Guo , Chunjing Xu , Yunhe Wang

Convolutional neural networks (CNNs) have been the consensus for medical image segmentation tasks. However, they suffer from the limitation in modeling long-range dependencies and spatial correlations due to the nature of convolution…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Moein Heidari , Amirhossein Kazerouni , Milad Soltany , Reza Azad , Ehsan Khodapanah Aghdam , Julien Cohen-Adad , Dorit Merhof

While convolutional neural networks (CNNs) and vision transformers (ViTs) have advanced medical image segmentation, they face inherent limitations such as local receptive fields in CNNs and high computational complexity in ViTs. This paper…

Image and Video Processing · Electrical Eng. & Systems 2025-04-02 Pooya Ashtari , Shahryar Noei , Fateme Nateghi Haredasht , Jonathan H. Chen , Giuseppe Jurman , Aleksandra Pizurica , Sabine Van Huffel

Fully Convolutional Neural Networks (FCNNs) with contracting and expanding paths have shown prominence for the majority of medical image segmentation applications since the past decade. In FCNNs, the encoder plays an integral role by…

Image and Video Processing · Electrical Eng. & Systems 2021-10-12 Ali Hatamizadeh , Yucheng Tang , Vishwesh Nath , Dong Yang , Andriy Myronenko , Bennett Landman , Holger Roth , Daguang Xu

Unsupervised image segmentation aims at grouping different semantic patterns in an image without the use of human annotation. Similarly, image clustering searches for groupings of images based on their semantic content without supervision.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Isaac Wasserman , Jeova Farias Sales Rocha Neto

We propose a novel transformer model, capable of segmenting medical images of varying modalities. Challenges posed by the fine grained nature of medical image analysis mean that the adaptation of the transformer for their analysis is still…

Image and Video Processing · Electrical Eng. & Systems 2023-01-31 Athanasios Tragakis , Chaitanya Kaul , Roderick Murray-Smith , Dirk Husmeier

Since Transformer has found widespread use in NLP, the potential of Transformer in CV has been realized and has inspired many new approaches. However, the computation required for replacing word tokens with image patches for Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Hezheng Lin , Xing Cheng , Xiangyu Wu , Fan Yang , Dong Shen , Zhongyuan Wang , Qing Song , Wei Yuan

Transformer based methods have achieved great success in image inpainting recently. However, we find that these solutions regard each pixel as a token, thus suffering from an information loss issue from two aspects: 1) They downsample the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Qiankun Liu , Yuqi Jiang , Zhentao Tan , Dongdong Chen , Ying Fu , Qi Chu , Gang Hua , Nenghai Yu

Current research on deep learning for medical image segmentation exposes their limitations in learning either global semantic information or local contextual information. To tackle these issues, a novel network named SegTransVAE is proposed…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Quan-Dung Pham , Hai Nguyen-Truong , Nam Nguyen Phuong , Khoa N. A. Nguyen

The hematology analytics used for detection and classification of small blood components is a significant challenge. In particular, when objects exists as small pixel-sized entities in a large context of similar objects. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 H. Martin Gillis , Ming Hill , Paul Hollensen , Alan Fine , Thomas Trappenberg

In the remote sensing context spectral unmixing is a technique to decompose a mixed pixel into two fundamental representatives: endmembers and abundances. In this paper, a novel architecture is proposed to perform blind unmixing on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Yasiru Ranasinghe , Sanjaya Herath , Kavinga Weerasooriya , Mevan Ekanayake , Roshan Godaliyadda , Parakrama Ekanayake , Vijitha Herath

While convolutional neural networks have shown a tremendous impact on various computer vision tasks, they generally demonstrate limitations in explicitly modeling long-range dependencies due to the intrinsic locality of the convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Guanglei Yang , Hao Tang , Mingli Ding , Nicu Sebe , Elisa Ricci

This paper studies the efficiency problem for visual transformers by excavating redundant calculation in given networks. The recent transformer architecture has demonstrated its effectiveness for achieving excellent performance on a series…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yehui Tang , Kai Han , Yunhe Wang , Chang Xu , Jianyuan Guo , Chao Xu , Dacheng Tao

Traditional deep learning methods in medical imaging often focus solely on segmentation or classification, limiting their ability to leverage shared information. Multi-task learning (MTL) addresses this by combining both tasks through…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Phuoc-Nguyen Bui , Duc-Tai Le , Junghyun Bum , Hyunseung Choo

Most recent scribble-supervised segmentation methods commonly adopt a CNN framework with an encoder-decoder architecture. Despite its multiple benefits, this framework generally can only capture small-range feature dependency for the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zihan Li , Yuan Zheng , Dandan Shan , Shuzhou Yang , Qingde Li , Beizhan Wang , Yuanting Zhang , Qingqi Hong , Dinggang Shen