English
Related papers

Related papers: TinyViT: Field Deployable Transformer Pipeline for…

200 papers

The few-shot learning ability of vision transformers (ViTs) is rarely investigated though heavily desired. In this work, we empirically find that with the same few-shot learning frameworks, \eg~Meta-Baseline, replacing the widely used CNN…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Bowen Dong , Pan Zhou , Shuicheng Yan , Wangmeng Zuo

The recently proposed Visual image Transformers (ViT) with pure attention have achieved promising performance on image recognition tasks, such as image classification. However, the routine of the current ViT model is to maintain a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Zizheng Pan , Bohan Zhuang , Jing Liu , Haoyu He , Jianfei Cai

Previous works on multi-label image recognition (MLIR) usually use CNNs as a starting point for research. In this paper, we take pure Vision Transformer (ViT) as the research base and make full use of the advantages of Transformer with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Yunqing Hu , Xuan Jin , Yin Zhang , Haiwen Hong , Jingfeng Zhang , Feihu Yan , Yuan He , Hui Xue

The automated surface defect detection is a fundamental task in industrial production, and the existing saliencybased works overcome the challenging scenes and give promising detection results. However, the cutting-edge efforts often suffer…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Kunye Shen , Xiaofei Zhou , Zhi Liu

Skin cancer is a global health concern, necessitating early and accurate diagnosis for improved patient outcomes. This study introduces a groundbreaking approach to skin cancer classification, employing the Vision Transformer, a…

Image and Video Processing · Electrical Eng. & Systems 2024-01-11 Galib Muhammad Shahriar Himel , Md. Masudul Islam , Kh Abdullah Al-Aff , Shams Ibne Karim , Md. Kabir Uddin Sikder

The detection and analysis of transient astronomical sources is of great importance to understand their time evolution. Traditional pipelines identify transient sources from difference (D) images derived by subtracting prior-observed…

Instrumentation and Methods for Astrophysics · Physics 2023-09-19 Zhuoyang Chen , Wenjie Zhou , Guoyou Sun , Mi Zhang , Jiangao Ruan , Jingyuan Zhao

The soiling level of heliostat mirrors in Concentrated Solar Power (CSP) fields is one of the key factors that significantly influences optical efficiency. State-of-the-art methods of monitoring heliostats soiling levels still face various…

Accurate delineation of agricultural field boundaries is essential for effective crop monitoring and resource management. However, competing methodologies often face significant challenges, particularly in their reliance on extensive manual…

Among several solutions to exploit solar energy, thermophotovoltaics (TPV) have been popularized and have known great breakthroughs during the past two decades. Yet, existing systems still have low efficiencies since the wavelength range of…

Mesoscale and Nanoscale Physics · Physics 2015-06-04 Elyes Nefzaoui , Jérémie Drevillon , Karl Joulain

PET provides in vivo molecular and functional imaging capability that is crucial to studying the interaction of plant with changing environment at the whole-plant level. We have developed a dedicated plant PET imager that features high…

Instrumentation and Detectors · Physics 2014-09-22 Qiang Wang , Aswin J. Mathews , Ke Li , Jie Wen , Sergey Komarov , Joseph A. O'Sullivan , Yuan-Chuan Tai

Cocoa (Theobroma cacao) is a critical cash crop for millions of smallholder farmers in West Africa, where Cocoa Swollen Shoot Virus Disease (CSSVD) and anthracnose cause devastating yield losses. Automated disease detection from leaf images…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Shouvik Sardar , Sourish Das

Manual Pap smear analysis for cervical cancer screening is limited by inter-observer variability, time constraints, and restricted expert availability. Although convolutional neural networks (CNNs) have automated cervical cell…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Nisreen Albzour , Sarah S. Lam

We study a crucial yet often overlooked issue inherent to Vision Transformers (ViTs): feature maps of these models exhibit grid-like artifacts, which hurt the performance of ViTs in downstream dense prediction tasks such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiawei Yang , Katie Z Luo , Jiefeng Li , Congyue Deng , Leonidas Guibas , Dilip Krishnan , Kilian Q Weinberger , Yonglong Tian , Yue Wang

This research paper presents the development of a lightweight and efficient computer vision pipeline aimed at assisting farmers in detecting orange diseases using minimal resources. The proposed system integrates advanced object detection,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Harsh Joshi

This study details an artificial intelligence (AI)-based methodology for the semantic segmentation of space camera faults. Specifically, we address the segmentation of straylight effects induced by solar presence around the camera's Field…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Riccardo Gallon , Fabian Schiemenz , Alessandra Menicucci , Eberhard Gill

The Vision Transformer (ViT) architecture has become widely recognized in computer vision, leveraging its self-attention mechanism to achieve remarkable success across various tasks. Despite its strengths, ViT's optimization remains…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Haoyu Yun , Hamid Krim

Accurate and timely cancer diagnosis from histopathological slides is vital for effective clinical decision-making. This paper introduces DepViT-CAD, a deployable AI system for multi-class cancer diagnosis in histopathology. At its core is…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Ashkan Shakarami , Lorenzo Nicole , Rocco Cappellesso , Angelo Paolo Dei Tos , Stefano Ghidoni

Vision Transformers (ViTs) have successfully been applied to image classification problems where large annotated datasets are available. On the other hand, when fewer annotations are available, such as in biomedical applications, image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Felipe A. Quezada , Carlos F. Navarro , Cristian Muñoz , Manuel Zamorano , Jorge Jara-Wilde , Violeta Chang , Cristóbal A. Navarro , Mauricio Cerda

Tea leaf diseases are a major challenge to agricultural productivity, with far-reaching implications for yield and quality in the tea industry. The rise of machine learning has enabled the development of innovative approaches to combat…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Faruk Ahmed , Md. Taimur Ahad , Yousuf Rayhan Emon

Vision Transformers (ViTs) have demonstrated outstanding performance in computer vision tasks, yet their high computational complexity prevents their deployment in computing resource-constrained environments. Various token pruning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Xuwei Xu , Changlin Li , Yudong Chen , Xiaojun Chang , Jiajun Liu , Sen Wang