English
Related papers

Related papers: Beyond ViT Tokens: Masked-Diffusion Pretrained Con…

200 papers

Standard deep learning models such as convolutional neural networks (CNNs) lack the ability of generalizing to domains which have not been seen during training. This problem is mainly due to the common but often wrong assumption of such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Gustavo A. Vargas Hakim , David Osowiechi , Ismail Ben Ayed , Christian Desrosiers

Unsupervised anomaly segmentation aims to detect patterns that are distinct from any patterns processed during training, commonly called abnormal or out-of-distribution patterns, without providing any associated manual segmentations. Since…

Image and Video Processing · Electrical Eng. & Systems 2023-11-06 Ziyun Liang , Harry Anthony , Felix Wagner , Konstantinos Kamnitsas

Medical image segmentation typically adopts a point-wise convolutional segmentation head to predict dense labels, where each output channel is heuristically tied to a specific class. This rigid design limits both feature sharing and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Bin Xie , Gady Agam

Recent diffusion models increasingly favor Transformer backbones, motivated by the remarkable scalability of fully attentional architectures. Yet the locality bias, parameter efficiency, and hardware friendliness--the attributes that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Taesung Kwon , Lorenzo Bianchi , Lennart Wittke , Felix Watine , Fabio Carrara , Jong Chul Ye , Romann Weber , Vinicius Azevedo

Continuous Conditional Diffusion Model (CCDM) is a diffusion-based framework designed to generate high-quality images conditioned on continuous regression labels. Although CCDM has demonstrated clear advantages over prior approaches across…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xin Ding , Yun Chen , Sen Zhang , Kao Zhang , Nenglun Chen , Peibei Cao , Yongwei Wang , Fei Wu

Accurate mitotic figure classification is crucial in computational pathology, as mitotic activity informs cancer grading and patient prognosis. Distinguishing atypical mitotic figures (AMFs), which indicate higher tumor aggressiveness, from…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Hana Feki , Alice Blondel , Thomas Walter

This paper addresses the challenges of designing mesh convolution neural networks for 3D mesh dense prediction. While deep learning has achieved remarkable success in image dense prediction tasks, directly applying or extending these…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Shi Hezi , Jiang Luo , Zheng Jianmin , Zeng Jun

Vision transformers (ViTs) have recently been widely applied to 3D point cloud understanding, with masked autoencoding as the predominant pre-training paradigm. However, the challenge of learning dense and informative semantic features from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Bin Ren , Xiaoshui Huang , Mengyuan Liu , Hong Liu , Fabio Poiesi , Nicu Sebe , Guofeng Mei

Foundation models are increasingly developed in computational pathology (CPath) given their promise in facilitating many downstream tasks. While recent studies have evaluated task performance across models, less is known about the structure…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Vaibhav Mishra , William Lotter

Unsupervised anomaly detection in brain images is crucial for identifying injuries and pathologies without access to labels. However, the accurate localization of anomalies in medical images remains challenging due to the inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Farzad Beizaee , Gregory Lodygensky , Christian Desrosiers , Jose Dolz

Vision transformers (ViTs) have dominated computer vision in recent years. However, ViTs are computationally expensive and not well suited for mobile devices; this led to the prevalence of convolutional neural network (CNN) and ViT-based…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Mustafa Munir , Md Mostafijur Rahman , Radu Marculescu

Masking strategies commonly employed in natural language processing are still underexplored in vision tasks such as concept learning, where conventional methods typically rely on full images. However, using masked images diversifies…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yuwei Sun , Lu Mi , Ippei Fujisawa , Ruiqiao Mei , Jimin Chen , Siyu Zhu , Ryota Kanai

Computed Tomography (CT) is a widely utilized imaging modality in clinical settings. Using densely acquired rotational X-ray arrays, CT can capture 3D spatial features. However, it is confronted with challenged such as significant time…

Image and Video Processing · Electrical Eng. & Systems 2025-07-16 Duoyou Chen , Yunqing Chen , Can Zhang , Zhou Wang , Cheng Chen , Ruoxiu Xiao

Masked Image Modeling (MIM) offers a promising approach to self-supervised representation learning, however existing MIM models still lag behind the state-of-the-art. In this paper, we systematically analyze target representations, loss…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Timothée Darcet , Federico Baldassarre , Maxime Oquab , Julien Mairal , Piotr Bojanowski

Cell painting is a popular technique for creating human-interpretable, high-contrast images of cell morphology. There are two major issues with cell paint: (1) it is labor-intensive and (2) it requires chemical fixation, making the study of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Alexander Peysakhovich , William Berman , Joseph Rufo , Felix Wong , Maxwell Z. Wilson

In this paper, we propose a new deep framework which predicts facial attributes and leverage it as a soft modality to improve face identification performance. Our model is an end to end framework which consists of a convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Fariborz Taherkhani , Nasser M. Nasrabadi , Jeremy Dawson

Masked image modeling (MIM) has demonstrated impressive results in self-supervised representation learning by recovering corrupted image patches. However, most existing studies operate on low-level image pixels, which hinders the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Zhiliang Peng , Li Dong , Hangbo Bao , Qixiang Ye , Furu Wei

Computer assisted diagnosis in digital pathology is becoming ubiquitous as it can provide more efficient and objective healthcare diagnostics. Recent advances have shown that the convolutional Neural Network (CNN) architectures, a…

Image and Video Processing · Electrical Eng. & Systems 2022-01-05 Sruthi Krishna , Suganthi S. S , Shivsubramani Krishnamoorthy , Arnav Bhavsar

Small CNN-based models usually require transferring knowledge from a large model before they are deployed in computationally resource-limited edge devices. Masked image modeling (MIM) methods achieve great success in various visual tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Ziming Wang , Shumin Han , Xiaodi Wang , Jing Hao , Xianbin Cao , Baochang Zhang

Vision foundation models (VFMs), such as DINOv3, provide rich semantic representations that are promising for computational pathology. However, many current adaptations pair frozen VFMs with lightweight decoders, creating a capacity…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Tianyang Wang , Ziyu Su , Abdul Rehman Akbar , Usama Sajjad , Usman Afzaal , Lina Gokhale , Charles Rabolli , Wei Chen , Anil Parwani , Muhammad Khalid Khan Niazi