English
Related papers

Related papers: SEM-CLIP: Precise Few-Shot Learning for Nanoscale …

200 papers

In the field of medical decision-making, precise anomaly detection in medical imaging plays a pivotal role in aiding clinicians. However, previous work is reliant on large-scale datasets for training anomaly detection models, which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Ximiao Zhang , Min Xu , Dehui Qiu , Ruixin Yan , Ning Lang , Xiuzhuang Zhou

Few-shot semantic segmentation addresses the learning task in which only few images with ground truth pixel-level labels are available for the novel classes of interest. One is typically required to collect a large mount of data (i.e., base…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Yuan-Hao Lee , Fu-En Yang , Yu-Chiang Frank Wang

Multimodal fusion breaks through the boundaries between diverse modalities and has already achieved notable performances. However, in many specialized fields, it is struggling to obtain sufficient alignment data for training, which…

Machine Learning · Computer Science 2024-09-24 Zijia Song , Zelin Zang , Yelin Wang , Guozheng Yang , Kaicheng yu , Wanyu Chen , Miaoyu Wang , Stan Z. Li

Few-shot segmentation aims at assigning a category label to each image pixel with few annotated samples. It is a challenging task since the dense prediction can only be achieved under the guidance of latent features defined by sparse…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Kai Zhu , Wei Zhai , Zheng-Jun Zha , Yang Cao

Just like other few-shot learning problems, few-shot segmentation aims to minimize the need for manual annotation, which is particularly costly in segmentation tasks. Even though the few-shot setting reduces this cost for novel test…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Mustafa Sercan Amac , Ahmet Sencan , Orhun Bugra Baran , Nazli Ikizler-Cinbis , Ramazan Gokberk Cinbis

Fine-grained anomaly detection is crucial in industrial and medical applications, but labeled anomalies are often scarce, making zero-shot detection challenging. While vision-language models like CLIP offer promising solutions, they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Ming Hu , Yongsheng Huo , Mingyu Dou , Jianfu Yin , Peng Zhao , Yao Wang , Cong Hu , Bingliang Hu , Quan Wang

Visual language models like Contrastive Language-Image Pretraining (CLIP) have shown impressive performance in analyzing natural images with language information. However, these models often encounter challenges when applied to specialized…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Jiaqing Zhang , Mingxiang Cao , Xue Yang , Kai Jiang , Yunsong Li

Few-shot segmentation remains challenging due to the limitations of its labeling information for unseen classes. Most previous approaches rely on extracting high-level feature maps from the frozen visual encoder to compute the pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Jin Wang , Bingfeng Zhang , Jian Pang , Honglong Chen , Weifeng Liu

Integrated silicon photonic devices, which manipulate light to transmit and process information on a silicon-on-insulator chip, are highly sensitive to structural variations. Minor deviations during nanofabrication-the precise process of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Rambod Azimi , Yijian Kong , Dusan Gostimirovic , James J. Clark , Odile Liboiron-Ladouceur

Scanning electron microscopy (SEM), a century-old technique, is today a ubiquitous method of imaging the surface of nanostructures. However, most SEM detectors simply count the number of secondary electrons from a material of interest, and…

We consider the task of learning a classifier for semantic segmentation using weak supervision in the form of image labels which specify the object classes present in the image. Our method uses deep convolutional neural networks (CNNs) and…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Qinbin Hou , Puneet Kumar Dokania , Daniela Massiceti , Yunchao Wei , Ming-Ming Cheng , Philip Torr

Image segmentation is fundamental to microstructural analysis for defect identification and structure-property correlation, yet remains challenging due to pronounced heterogeneity in materials images arising from varied processing and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Sanjeev S. Navaratna , Nikhil Thawari , Gunashekhar Mari , Amritha V P , Murugaiyan Amirthalingam , Rohit Batra

To address the annotation scarcity issue in some cases of semantic segmentation, there have been a few attempts to develop the segmentation model in the few-shot learning paradigm. However, most existing methods only focus on the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Pinzhuo Tian , Zhangkai Wu , Lei Qi , Lei Wang , Yinghuan Shi , Yang Gao

Contrastive Language-Image Pretraining (CLIP) achieves strong generalization in vision-language tasks by aligning images and texts in a shared embedding space. However, recent findings show that CLIP-like models still underutilize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Weiheng Zhao , Zilong Huang , Jiashi Feng , Xinggang Wang

In the realm of industrial quality inspection, defect detection stands as a critical component, particularly in high-precision, safety-critical sectors such as automotive components aerospace, and medical devices. Traditional methods,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Shuai Li , Shihan Chen , Wanru Geng , Zhaohua Xu , Xiaolu Liu , Can Dong , Zhen Tian , Changlin Chen

While Contrastive Language-Image Pretraining (CLIP) excels at zero-shot tasks by aligning image and text embeddings, its performance in few-shot classification is hindered by a critical limitation: intra-modal misalignment. This issue,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Christoph Timmermann , Hyunse Lee , Woojin Lee

In fine-grained road scene understanding, semantic segmentation plays a crucial role in enabling vehicles to perceive and comprehend their surroundings. By assigning a specific class label to each pixel in an image, it allows for precise…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yuting Hong , Yongkang Wu , Hui Xiao , Huazheng Hao , Xiaojie Qiu , Baochen Yao , Chengbin Peng

Few-shot semantic segmentation aims to segment novel-class objects in a query image with only a few annotated examples in support images. Most of advanced solutions exploit a metric learning framework that performs segmentation through…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Jiacheng Chen , Bin-Bin Gao , Zongqing Lu , Jing-Hao Xue , Chengjie Wang , Qingmin Liao

Deep learning-based semiconductor defect inspection has gained traction in recent years, offering a powerful and versatile approach that provides high accuracy, adaptability, and efficiency in detecting and classifying nano-scale defects.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Amit Prasad , Bappaditya Dey , Victor Blanco , Sandip Halder

Few-shot segmentation has garnered significant attention. Many recent approaches attempt to introduce the Segment Anything Model (SAM) to handle this task. With the strong generalization ability and rich object-specific extraction ability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Jin Wang , Bingfeng Zhang , Jian Pang , Weifeng Liu , Baodi Liu , Honglong Chen