English
Related papers

Related papers: DINO-QPM: Adapting Visual Foundation Models for Gl…

200 papers

In hematology, computational models offer significant potential to improve diagnostic accuracy, streamline workflows, and reduce the tedious work of analyzing single cells in peripheral blood or bone marrow smears. However, clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Valentin Koch , Sophia J. Wagner , Salome Kazeminia , Ece Sancar , Matthias Hehr , Julia Schnabel , Tingying Peng , Carsten Marr

In this paper, we develop a deep learning approach for the accurate solution of challenging problems of near-field microscopy that leverages the powerful framework of physics-informed neural networks (PINNs) for the inversion of the complex…

Optics · Physics 2024-06-12 Yuyao Chen , Luca Dal Negro

Grounding-DINO is a state-of-the-art open-set detection model that tackles multiple vision tasks including Open-Vocabulary Detection (OVD), Phrase Grounding (PG), and Referring Expression Comprehension (REC). Its effectiveness has led to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Xiangyu Zhao , Yicheng Chen , Shilin Xu , Xiangtai Li , Xinjiang Wang , Yining Li , Haian Huang

Transformers, the de-facto standard for language modeling, have been recently applied for vision tasks. This paper introduces sparse queries for vision transformers to exploit the intrinsic spatial redundancy of natural images and save…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Lin Song , Songyang Zhang , Songtao Liu , Zeming Li , Xuming He , Hongbin Sun , Jian Sun , Nanning Zheng

Many interpretable AI approaches have been proposed to provide plausible explanations for a model's decision-making. However, configuring an explainable model that effectively communicates among computational modules has received less…

Machine Learning · Computer Science 2023-11-09 Jinyung Hong , Keun Hee Park , Theodore P. Pavlic

Vision Foundation Models (VFMs) have become the cornerstone of modern computer vision, offering robust representations across a wide array of tasks. While recent advances allow these models to handle varying input sizes during training,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Bocheng Zou , Mu Cai , Mark Stanley , Dingfu Lu , Yong Jae Lee

Due to their black-box and data-hungry nature, deep learning techniques are not yet widely adopted for real-world applications in critical domains, like healthcare and justice. This paper presents Memory Wrap, a plug-and-play extension to…

Machine Learning · Computer Science 2023-10-30 Biagio La Rosa , Roberto Capobianco , Daniele Nardi

A core challenge in the interpretation of deep neural networks is identifying commonalities between the underlying algorithms implemented by distinct networks trained for the same task. Motivated by this problem, we introduce DYNAMO, an…

Machine Learning · Computer Science 2023-03-01 Jordan Cotler , Kai Sheng Tai , Felipe Hernández , Blake Elias , David Sussillo

Masked image modeling (MIM) has emerged as a promising approach for pre-training Vision Transformers (ViTs). MIMs predict masked tokens token-wise to recover target signals that are tokenized from images or generated by pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Taekyung Kim , Byeongho Heo , Dongyoon Han

Unsupervised anomaly detection (AD) in medical images aims to identify abnormal regions without relying on pixel-level annotations, which is crucial for scalable and label-efficient diagnostic systems. In this paper, we propose a novel…

Image and Video Processing · Electrical Eng. & Systems 2026-02-05 Jiayu Huo , Jingyuan Hong , Liyun Chen

Deep neural networks (DNNs) are powerful black-box predictors that have achieved impressive performance on a wide variety of tasks. However, their accuracy comes at the cost of intelligibility: it is usually unclear how they make their…

Machine Learning · Computer Science 2021-10-26 Rishabh Agarwal , Levi Melnick , Nicholas Frosst , Xuezhou Zhang , Ben Lengerich , Rich Caruana , Geoffrey Hinton

Due to the high complexity and technical requirements of industrial production processes, surface defects will inevitably appear, which seriously affects the quality of products. Although existing lightweight detection networks are highly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xuyi Yu

Despite the high accuracy offered by state-of-the-art deep natural-language models (e.g. LSTM, BERT), their application in real-life settings is still widely limited, as they behave like a black-box to the end-user. Hence, explainability is…

Computation and Language · Computer Science 2021-06-15 Francesco Ventura , Salvatore Greco , Daniele Apiletti , Tania Cerquitelli

Visual place recognition (VPR) aims to determine the general geographical location of a query image by retrieving visually similar images from a large geo-tagged database. To obtain a global representation for each place image, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Tong Jin , Feng Lu , Shuyu Hu , Chun Yuan , Yunpeng Liu

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Vision Foundation Models (VFMs) and Vision Language Models (VLMs) have revolutionized computer vision by providing rich semantic and geometric representations. This paper presents a comprehensive visual comparison between CLIP based and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Md Selim Sarowar , Sungho Kim

Diffusion Probabilistic Models (DPMs) have been recently utilized to deal with various blind image restoration (IR) tasks, where they have demonstrated outstanding performance in terms of perceptual quality. However, the task-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Magauiya Zhussip , Iaroslav Koshelev , Stamatis Lefkimmiatis

Foundation models (FMs) have revolutionized computer vision, enabling effective learning across different domains. However, their performance under domain shift is yet underexplored. This paper investigates the zero-shot domain adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ugur Ali Kaplan , Margret Keuper , Anna Khoreva , Dan Zhang , Yumeng Li

Vision-language models (VLMs) are increasingly deployed in socially sensitive applications, yet their behavior with respect to disability remains underexplored. We study disability aware descriptions for person centric images, where models…

Artificial Intelligence · Computer Science 2026-01-27 Srikant Panda , Sourabh Singh Yadav , Palkesh Malviya

Quantitative phase imaging (QPI) has been widely applied in characterizing cells and tissues. Spatial light interference microscopy (SLIM) is a highly sensitive QPI method, due to its partially coherent illumination and common path…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Yuheng Jiao , Yuchen R. He , Mikhail E. Kandel , Xiaojun Liu , Wenlong Lu , Gabriel Popescu