中文
相关论文

相关论文: SEM-CLIP: Precise Few-Shot Learning for Nanoscale …

200 篇论文

Learning generalized representations from limited training samples is crucial for applying deep neural networks in low-resource scenarios. Recently, methods based on Contrastive Language-Image Pre-training (CLIP) have exhibited promising…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Yao Zhu , Yuefeng Chen , Wei Wang , Xiaofeng Mao , Xiu Yan , Yue Wang , Zhigang Li , Wang lu , Jindong Wang , Xiangyang Ji

Scanning Electron Microscopy (SEM) is a widely used tool for nanoparticle characterization, but long-term directional drift can compromise image quality. We present a novel algorithm for post-imaging drift correction in SEM nanoparticle…

Precision in identifying nanometer-scale device-killer defects is crucial in both semiconductor research and development as well as in production processes. The effectiveness of existing ML-based approaches in this context is largely…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Bappaditya Dey , Vic De Ridder , Victor Blanco , Sandip Halder , Bartel Van Waeyenberge

In this article, a new scanning electron microscopy (SEM) image composition technique is described, which can significantly reduce drift related image corruptions. Drift-distortion commonly causes blur and distortions in the SEM images.…

仪器与探测器 · 物理学 2010-08-09 Petr Cizmar , Andras E. Vladar , Michael T. Postek

Visual anomaly classification and segmentation are vital for automating industrial quality inspection. The focus of prior research in the field has been on training custom models for each quality inspection task, which requires…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Jongheon Jeong , Yang Zou , Taewan Kim , Dongqing Zhang , Avinash Ravichandran , Onkar Dabeer

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Cheng Cheng , Lin Song , Ruoyi Xue , Hang Wang , Hongbin Sun , Yixiao Ge , Ying Shan

Vision-language foundation models have exhibited remarkable success across a multitude of downstream tasks due to their scalability on extensive image-text paired data. However, these models also display significant limitations when applied…

计算机视觉与模式识别 · 计算机科学 2025-01-15 Huan Ma , Yan Zhu , Changqing Zhang , Peilin Zhao , Baoyuan Wu , Long-Kai Huang , Qinghua Hu , Bingzhe Wu

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

计算机视觉与模式识别 · 计算机科学 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

This expository paper introduces a simplified approach to image-based quality inspection in manufacturing using OpenAI's CLIP (Contrastive Language-Image Pretraining) model adapted for few-shot learning. While CLIP has demonstrated…

Fine-tuning vision-language models (VLMs) like CLIP to downstream tasks is often necessary to optimize their performance. However, a major obstacle is the limited availability of labeled data. We study the use of pseudolabels, i.e.,…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Cristina Menghini , Andrew Delworth , Stephen H. Bach

In this study, we present a computational framework tailored for the precise detection and comprehensive analysis of nanoparticles within scanning electron microscopy (SEM) images. The primary objective of this framework revolves around the…

图像与视频处理 · 电气工程与系统科学 2023-08-21 Aidan S. Wright , Nathaniel P. Youmans , Enrique F. Valderrama Araya

Deep learning has demonstrated significant improvements in medical image segmentation using a sufficiently large amount of training data with manual labels. Acquiring well-representative labels requires expert knowledge and exhaustive…

计算机视觉与模式识别 · 计算机科学 2021-06-15 Jinxi Xiang , Zhuowei Li , Wenji Wang , Qing Xia , Shaoting Zhang

Contrastive Language-Image Pre-training (CLIP) has made a remarkable breakthrough in open-vocabulary zero-shot image recognition. Many recent studies leverage the pre-trained CLIP models for image-level classification and manipulation. In…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Chong Zhou , Chen Change Loy , Bo Dai

Transductive inference has been widely investigated in few-shot image classification, but completely overlooked in the recent, fast growing literature on adapting vision-langage models like CLIP. This paper addresses the transductive…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Ségolène Martin , Yunshi Huang , Fereshteh Shakeri , Jean-Christophe Pesquet , Ismail Ben Ayed

Few-shot semantic segmentation aims to learn to segment unseen class objects with the guidance of only a few support images. Most previous methods rely on the pixel-level label of support images. In this paper, we focus on a more…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Haohan Wang , Liang Liu , Wuhao Zhang , Jiangning Zhang , Zhenye Gan , Yabiao Wang , Chengjie Wang , Haoqian Wang

In industrial product quality assessment, it is essential to determine whether a product is defect-free and further analyze the severity of anomality. To this end, accurate defect segmentation on images of products provides an important…

计算机视觉与模式识别 · 计算机科学 2021-04-07 Dongyun Lin , Yanpeng Cao , Wenbing Zhu , Yiqun Li

Recently, CLIP has been applied to pixel-level zero-shot learning tasks via a two-stage scheme. The general idea is to first generate class-agnostic region proposals and then feed the cropped proposal regions to CLIP to utilize its…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Ziqin Zhou , Bowen Zhang , Yinjie Lei , Lingqiao Liu , Yifan Liu

Continual shrinking of pattern dimensions in the semiconductor domain is making it increasingly difficult to inspect defects due to factors such as the presence of stochastic noise and the dynamic behavior of defect patterns and types.…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Vic De Ridder , Bappaditya Dey , Enrique Dehaerne , Sandip Halder , Stefan De Gendt , Bartel Van Waeyenberge

This paper studies semi-supervised learning of semantic segmentation, which assumes that only a small portion of training images are labeled and the others remain unlabeled. The unlabeled images are usually assigned pseudo labels to be used…

计算机视觉与模式识别 · 计算机科学 2022-06-02 Donghyeon Kwon , Suha Kwak

Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essentially learn across a…

计算机视觉与模式识别 · 计算机科学 2021-07-21 Jinhai Yang , Hua Yang , Lin Chen