English
Related papers

Related papers: DINO-MX: A Modular & Flexible Framework for Self-S…

200 papers

Vision foundation models have shown great promise for open-set 3D object retrieval (3DOR) through efficient adaptation to multi-view images. Leveraging semantically aligned latent space, previous work typically adapts the CLIP encoder to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xinwei He , Yansong Zheng , Qianru Han , Zhichuan Wang , Yuxuan Cai , Yang Zhou , Jingbo Xia , Yulong Wang , Jinhai Xiang , Xiang Bai

Open-Vocabulary Segmentation (OVS) aims at segmenting images from free-form textual concepts without predefined training classes. While existing vision-language models such as CLIP can generate segmentation masks by leveraging coarse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Luca Barsellotti , Lorenzo Bianchi , Nicola Messina , Fabio Carrara , Marcella Cornia , Lorenzo Baraldi , Fabrizio Falchi , Rita Cucchiara

Recent advances in visual generation have emphasized the importance of Latent Generative Models (LGMs), which critically depend on effective visual tokenizers to bridge pixels and semantic representations. However, tokenizers constructed on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Mingkai Jia , Mingxiao Li , Zhijian Shu , Anlin Zheng , Liaoyuan Fan , Jiaxin Guo , Tianxing Shi , Dongyue Lu , Zeming Li , Xiaoyang Guo , Xiaojuan Qi , Xiao-Xiao Long , Qian Zhang , Ping Tan , Wei Yin

In this study, we present a multimodal framework for predicting neuro-facial disorders by capturing both vocal and facial cues. We hypothesize that explicitly disentangling shared and modality-specific representations within multimodal…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-13 Mohd Mujtaba Akhtar , Girish , Muskaan Singh

Like masked language modeling (MLM) in natural language processing, masked image modeling (MIM) aims to extract valuable insights from image patches to enhance the feature extraction capabilities of the underlying deep neural network (DNN).…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yixuan Luo , Mengye Ren , Sai Qian Zhang

Face recognition systems are increasingly used in biometric security for convenience and effectiveness. However, they remain vulnerable to spoofing attacks, where attackers use photos, videos, or masks to impersonate legitimate users. This…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Arman Keresh , Pakizar Shamoi

We present DINO-Tracker -- a new framework for long-term dense tracking in video. The pillar of our approach is combining test-time training on a single video, with the powerful localized semantic features learned by a pre-trained DINO-ViT…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Narek Tumanyan , Assaf Singer , Shai Bagon , Tali Dekel

The integration of deep learning systems into healthcare has been hindered by the resource-intensive process of data annotation and the inability of these systems to generalize to different data distributions. Foundation models, which are…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mohammed Baharoon , Waseem Qureshi , Jiahong Ouyang , Yanwu Xu , Abdulrhman Aljouie , Wei Peng

This paper evaluates DINOv3, a recent large-scale self-supervised vision backbone, for visuomotor diffusion policy learning in robotic manipulation. We investigate whether a purely self-supervised encoder can match or surpass conventional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 ThankGod Egbe , Peng Wang , Zhihao Guo , Zidong Chen

Many models of visual attention have been proposed so far. Traditional bottom-up models, like saliency models, fail to replicate human gaze patterns, and deep gaze prediction models lack biological plausibility due to their reliance on…

Neurons and Cognition · Quantitative Biology 2025-05-28 Takuto Yamamoto , Hirosato Akahoshi , Shigeru Kitazawa

Object-centric understanding is fundamental to human vision and required for complex reasoning. Traditional methods define slot-based bottlenecks to learn object properties explicitly, while recent self-supervised vision models like DINO…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Stefan Sylvius Wagner , Stefan Harmeling

Medical image registration is a critical component of clinical imaging workflows, enabling accurate longitudinal assessment, multi-modal data fusion, and image-guided interventions. Intensity-based approaches often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Eytan Kats , Mattias P. Heinrich

Despite the significant advancements in general image segmentation achieved by large-scale pre-trained foundation models (such as Meta's Segment Any-thing Model (SAM) series and DINOv2), their performance in specialized fields remains…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yimin Xu , Fan Yang , Bin Xu

Vision foundation models trained with self-supervised objectives achieve strong performance across diverse tasks and exhibit emergent object segmentation properties. However, their alignment with human object perception remains poorly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Hossein Adeli , Seoyoung Ahn , Andrew Luo , Mengmi Zhang , Nikolaus Kriegeskorte , Gregory Zelinsky

This paper introduces a novel approach to leverage features learned from both supervised and self-supervised paradigms, to improve image classification tasks, specifically for vehicle classification. Two state-of-the-art self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Shihan Ma , Jidong J. Yang

Deep learning underlies most modern approaches and tools in computer vision, including biomedical imaging. However, for interactive semantic segmentation (often called pixel classification in this context) and interactive object-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Carolin Teuber , Anwai Archit , Tobias Boothe , Peter Ditte , Jochen Rink , Constantin Pape

Foundation models pre-trained on large-scale natural image datasets offer a powerful paradigm for medical image segmentation. However, effectively transferring their learned representations for precise clinical applications remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Haoyue Li , Yifan Gao , Feng Yuan , Xiaosong Wang , Xin Gao

Recently, feature upsampling has gained increasing attention owing to its effectiveness in enhancing vision foundation models (VFMs) for pixel-level understanding tasks. Existing methods typically rely on high-resolution features from the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xiaoqiong Liu , Heng Fan

Vision Foundation Models (VFMs) and Vision Language Models (VLMs) have revolutionized computer vision by providing rich semantic and geometric representations. This paper presents a comprehensive visual comparison between CLIP based and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Md Selim Sarowar , Sungho Kim

In this paper, we present a comparative analysis of various self-supervised Vision Transformers (ViTs), focusing on their local representative power. Inspired by large language models, we examine the abilities of ViTs to perform various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Ani Vanyan , Alvard Barseghyan , Hakob Tamazyan , Vahan Huroyan , Hrant Khachatrian , Martin Danelljan