English
Related papers

Related papers: Towards Hierarchical Regional Transformer-based Mu…

200 papers

Recently, the application of deep learning in image colorization has received widespread attention. The maturation of diffusion models has further advanced the development of image colorization models. However, current mainstream image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yanru An , Ling Gui , Chunlei Cai , Tianxiao Ye , JIangchao Yao , Guangtao Zhai , Qiang Hu , Xiaoyun Zhang

In digital pathology, whole slide images (WSIs) are widely used for applications such as cancer diagnosis and prognosis prediction. Visual transformer models have recently emerged as a promising method for encoding large regions of WSIs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shuai Jiang , Liesbeth Hondelink , Arief A. Suriawinata , Saeed Hassanpour

In this work, we present a deep learning-based approach for image tampering localization fusion. This approach is designed to combine the outcomes of multiple image forensics algorithms and provides a fused tampering localization map, which…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Polychronis Charitidis , Giorgos Kordopatis-Zilos , Symeon Papadopoulos , Ioannis Kompatsiaris

Vision transformer (ViT) has recently shown its strong capability in achieving comparable results to convolutional neural networks (CNNs) on image classification. However, vanilla ViT simply inherits the same architecture from the natural…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Chun-Fu Chen , Rameswar Panda , Quanfu Fan

Multiple instance learning (MIL) has enabled substantial progress in computational histopathology, where a large amount of patches from gigapixel whole slide images are aggregated into slide-level predictions. Heatmaps are widely used to…

Whole slide image (WSI) refers to a type of high-resolution scanned tissue image, which is extensively employed in computer-assisted diagnosis (CAD). The extremely high resolution and limited availability of region-level annotations make…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ruijie Zhang , Qiaozhe Zhang , Yingzhuang Liu , Hao Xin , Yan Liu , Xinggang Wang

Transformer-based models have been achieving state-of-the-art results in several fields of Natural Language Processing. However, its direct application to speech tasks is not trivial. The nature of this sequences carries problems such as…

Computation and Language · Computer Science 2022-05-17 Gerard Sant , Gerard I. Gállego , Belen Alastruey , Marta R. Costa-Jussà

Data is one of the essential ingredients to power deep learning research. Small datasets, especially specific to medical institutes, bring challenges to deep learning training stage. This work aims to develop a practical deep multimodal…

Machine Learning · Computer Science 2019-02-26 Faik Aydin , Maggie Zhang , Michelle Ananda-Rajah , Gholamreza Haffari

Histopathology has played an essential role in cancer diagnosis. With the rapid advances in convolutional neural networks (CNN). Various CNN-based automated pathological image segmentation approaches have been developed in computer-assisted…

Image and Video Processing · Electrical Eng. & Systems 2021-09-23 Cam Nguyen , Zuhayr Asad , Yuankai Huo

Spectrum prediction is considered as a key technology to assist spectrum decision. Despite the great efforts that have been put on the construction of spectrum prediction, achieving accurate spectrum prediction emphasizes the need for more…

Signal Processing · Electrical Eng. & Systems 2025-03-25 Guangliang Pan , Jie Li , Minglei Li

Vision Transformer (ViT) models have demonstrated a breakthrough in a wide range of computer vision tasks. However, compared to the Convolutional Neural Network (CNN) models, it has been observed that the ViT models struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Reza Azad , Amirhossein Kazerouni , Babak Azad , Ehsan Khodapanah Aghdam , Yury Velichko , Ulas Bagci , Dorit Merhof

We consider the problem of composed image retrieval that takes an input query consisting of an image and a modification text indicating the desired changes to be made on the image and retrieves images that match these changes. Current…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Prateksha Udhayanan , Srikrishna Karanam , Balaji Vasan Srinivasan

The current trend of automating inspections at substations has sparked a surge in interest in the field of transformer image recognition. However, due to restrictions in the number of parameters in existing models, high-resolution images…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Siyi Zhang , Cheng Liu , Xiang Li , Xin Zhai , Zhen Wei , Sizhe Li , Xun Ma

Region proposal based methods like R-CNN and Faster R-CNN models have proven to be extremely successful in object detection and segmentation tasks. Recently, Transformers have also gained popularity in the domain of Computer Vision, and are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Deepanshu Pandey , Pradyumna Gupta , Sumit Bhattacharya , Aman Sinha , Rohit Agarwal

We present an efficient approach for Masked Image Modeling (MIM) with hierarchical Vision Transformers (ViTs), allowing the hierarchical ViTs to discard masked patches and operate only on the visible ones. Our approach consists of three key…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Lang Huang , Shan You , Mingkai Zheng , Fei Wang , Chen Qian , Toshihiko Yamasaki

Whole Slide Images (WSIs) present a challenging computer vision task due to their gigapixel size and presence of numerous artefacts. Yet they are a valuable resource for patient diagnosis and stratification, often representing the gold…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Amaya Gallagher-Syed , Luca Rossi , Felice Rivellese , Costantino Pitzalis , Myles Lewis , Michael Barnes , Gregory Slabaugh

The scarcity of richly annotated medical images is limiting supervised deep learning based solutions to medical image analysis tasks, such as localizing discriminatory radiomic disease signatures. Therefore, it is desirable to leverage…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Saeid Asgari Taghanaki , Mohammad Havaei , Tess Berthier , Francis Dutil , Lisa Di Jorio , Ghassan Hamarneh , Yoshua Bengio

In this work, we propose a novel methodology for self-supervised learning for generating global and local attention-aware visual features. Our approach is based on training a model to differentiate between specific image transformations of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Trung X. Pham , Rusty John Lloyd Mina , Dias Issa , Chang D. Yoo

Multiple Instance Learning (MIL) is a cornerstone approach in computational pathology (CPath) for generating clinically meaningful slide-level embeddings from gigapixel tissue images. However, MIL often struggles with small, weakly…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Daniel Shao , Richard J. Chen , Andrew H. Song , Joel Runevic , Ming Y. Lu , Tong Ding , Faisal Mahmood

Transformer is a ubiquitous model for natural language processing and has attracted wide attentions in computer vision. The attention maps are indispensable for a transformer model to encode the dependencies among input tokens. However,…

Machine Learning · Computer Science 2021-02-26 Yujing Wang , Yaming Yang , Jiangang Bai , Mingliang Zhang , Jing Bai , Jing Yu , Ce Zhang , Gao Huang , Yunhai Tong