English
Related papers

Related papers: Every SAM Drop Counts: Embracing Semantic Priors f…

200 papers

Multi-modal semantic segmentation significantly enhances AI agents' perception and scene understanding, especially under adverse conditions like low-light or overexposed environments. Leveraging additional modalities (X-modality) like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zifu Wan , Pingping Zhang , Yuhao Wang , Silong Yong , Simon Stepputtis , Katia Sycara , Yaqi Xie

Nuclei instance segmentation is critical in computational pathology for cancer diagnosis and prognosis. Recently, the Segment Anything Model has demonstrated exceptional performance in various segmentation tasks, leveraging its rich priors…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jingze Su , Tianle Zhu , Jiaxin Cai , Zhiyi Wang , Qi Li , Xiao Zhang , Tong Tong , Shu Wang , Wenxi Liu

Segmentation quality assessment (SQA) plays a critical role in the deployment of a medical image based AI system. Users need to be informed/alerted whenever an AI system generates unreliable/incorrect predictions. With the introduction of…

Image and Video Processing · Electrical Eng. & Systems 2023-12-18 Yizhe Zhang , Shuo Wang , Tao Zhou , Qi Dou , Danny Z. Chen

Image-based crack detection algorithms are increasingly in demand in infrastructure monitoring, as early detection of cracks is of paramount importance for timely maintenance planning. While deep learning has significantly advanced crack…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ghodsiyeh Rostami , Po-Han Chen , Mahdi S. Hosseini

Understanding human intentions (e.g., emotions) from videos has received considerable attention recently. Video streams generally constitute a blend of temporal data stemming from distinct modalities, including natural language, facial…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Dingkang Yang , Mingcheng Li , Linhao Qu , Kun Yang , Peng Zhai , Song Wang , Lihua Zhang

The Segment Anything Model (SAM) has advanced interactive segmentation but is limited by the high computational cost on high-resolution images. This requires downsampling to meet GPU constraints, sacrificing the fine-grained details needed…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 You Huang , Wenbin Lai , Jiayi Ji , Liujuan Cao , Shengchuan Zhang , Rongrong Ji

Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jay N. Paranjape , Nithin Gopalakrishnan Nair , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Neuroscience employs diverse neuroimaging techniques, each offering distinct insights into brain activity, from electrophysiological recordings such as EEG, which have high temporal resolution, to hemodynamic modalities such as fMRI, which…

The Segment Anything Model (SAM), a foundation model pretrained on millions of images and segmentation masks, has significantly advanced semantic segmentation, a fundamental task in computer vision. Despite its strengths, SAM encounters two…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Li Zhang , Youwei Liang , Ruiyi Zhang , Amirhosein Javadi , Pengtao Xie

Flow matching has recently emerged as a principled framework for learning continuous-time transport maps, enabling efficient ODE-based sampling without relying on stochastic diffusion processes. While generative modeling has shown promise…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zhi Chen , Runze Hu , Le Zhang

Accurate perception of dynamic traffic scenes is crucial for high-level autonomous driving systems, requiring robust object motion estimation and instance segmentation. However, traditional methods often treat them as separate tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yinqi Chen , Meiying Zhang , Qi Hao , Guang Zhou

This paper focuses on a highly practical scenario: how to continue benefiting from the advantages of multi-modal image fusion under harsh conditions when only visible imaging sensors are available. To achieve this goal, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Hao Zhang , Yanping Zha , Zizhuo Li , Meiqi Gong , Jiayi Ma

Sharpness-Aware Minimization (SAM) is an optimization method that improves generalization performance of machine learning models. Despite its superior generalization, SAM has not been actively used in real-world applications due to its…

Machine Learning · Computer Science 2025-03-17 Junhyuk Jo , Jihyun Lim , Sunwoo Lee

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

Despite remarkable progress in Single Image Super-Resolution (SISR), traditional models often struggle to generalize across varying scale factors, limiting their real-world applicability. To address this, we propose a plug-in Scale-Aware…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Dongsik Yoon , Jongeun Kim

Accurate semantic segmentation models typically require significant computational resources, inhibiting their use in practical applications. Recent works rely on well-crafted lightweight models to achieve fast inference. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Danna Xue , Fei Yang , Pei Wang , Luis Herranz , Jinqiu Sun , Yu Zhu , Yanning Zhang

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

Transformers have achieved state-of-the-art performance across language and vision tasks. This success drives the imperative to interpret their internal mechanisms with the dual goals of enhancing performance and improving behavioral…

Machine Learning · Computer Science 2025-06-23 Jingtong Su , Julia Kempe , Karen Ullrich

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optimal ability to learn…

Machine Learning · Computer Science 2021-01-29 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

While large visual models (LVM) demonstrated significant potential in image understanding, due to the application of large-scale pre-training, the Segment Anything Model (SAM) has also achieved great success in the field of image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Jiaqi Yang , Yaning Zhang , Jingxi Hu , Xiangjian He , Linlin Shen , Guoping Qiu