English
Related papers

Related papers: Scaling up self-supervised learning for improved s…

200 papers

Recent advancements in vision foundation models (VFMs) have opened up new possibilities for versatile and efficient visual perception. In this work, we introduce Seal, a novel framework that harnesses VFMs for segmenting diverse automotive…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Youquan Liu , Lingdong Kong , Jun Cen , Runnan Chen , Wenwei Zhang , Liang Pan , Kai Chen , Ziwei Liu

Large-scale vision models like SAM have extensive visual knowledge, yet their general nature and computational demands limit their use in specialized tasks like medical image segmentation. In contrast, task-specific models such as U-Net++…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Yuchen Mao , Hongwei Li , Yinyi Lai , Giorgos Papanastasiou , Peng Qi , Yunjie Yang , Chengjia Wang

Deep Learning (DL) requires a large amount of training data to provide quality outcomes. However, the field of medical imaging suffers from the lack of sufficient data for properly training DL models because medical images require manual…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Laith Alzubaidi , J. Santamaría , Mohamed Manoufali , Beadaa Mohammed , Mohammed A. Fadhel , Jinglan Zhang , Ali H. Al-Timemy , Omran Al-Shamma , Ye Duan

In the context of medical imaging and machine learning, one of the most pressing challenges is the effective adaptation of pre-trained models to specialized medical contexts. Despite the availability of advanced pre-trained models, their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Ana Davila , Jacinto Colan , Yasuhisa Hasegawa

Self-supervised learning (SSL) has emerged as a central paradigm for training foundation models by leveraging large-scale unlabeled datasets, often producing representations with strong generalization capabilities. These models are…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Brown Ebouky , Ajad Chhatkuli , Cristiano Malossi , Christoph Studer , Roy Assaf , Andrea Bartezzaghi

Deep convolutional neural networks (CNNs) are state-of-the-art for semantic image segmentation, but typically require many labeled training samples. Obtaining 3D segmentations of medical images for supervised training is difficult and labor…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Zhenlin Xu , Marc Niethammer

In recent years, the landscape of computer-assisted interventions and post-operative surgical video analysis has been dramatically reshaped by deep-learning techniques, resulting in significant advancements in surgeons' skills, operation…

Recent advances in self-supervised learning (SSL) in computer vision are primarily comparative, whose goal is to preserve invariant and discriminative semantics in latent representations by comparing siamese image views. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Hong-Yu Zhou , Chixiang Lu , Chaoqi Chen , Sibei Yang , Yizhou Yu

This paper addresses the task of semantic segmentation in computer vision, aiming to achieve precise pixel-wise classification. We investigate the joint training of models for semantic edge detection and semantic segmentation, which has…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Dan Zhang , Rui Zheng , Luosang Gadeng , Pei Yang

Recent advances in multimodal large language models (LLMs) have highlighted their potential for medical and surgical applications. However, existing surgical datasets predominantly adopt a Visual Question Answering (VQA) format with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Tae-Min Choi , Tae Kyeong Jeong , Garam Kim , Jaemin Lee , Yeongyoon Koh , In Cheul Choi , Jae-Ho Chung , Jong Woong Park , Juyoun Park

Recognizing the phases of a laparoscopic surgery (LS) operation form its video constitutes a fundamental step for efficient content representation, indexing and retrieval in surgical video databases. In the literature, most techniques focus…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Constantinos Loukas

The Critical View of Safety (CVS) is crucial for safe laparoscopic cholecystectomy, yet assessing CVS criteria remains a complex and challenging task, even for experts. Traditional models for CVS recognition depend on vision-only models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Britty Baby , Vinkle Srivastav , Pooja P. Jain , Kun Yuan , Pietro Mascagni , Nicolas Padoy

A major obstacle to building models for effective semantic segmentation, and particularly video semantic segmentation, is a lack of large and well annotated datasets. This bottleneck is particularly prohibitive in highly specialized and…

Surgical video understanding is a crucial prerequisite for advancing Computer-Assisted Surgery. While vision-language models (VLMs) have recently been applied to the surgical domain, existing surgical vision-language datasets lack in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Lennart Maack , Alexander Schlaefer

Pre-training general-purpose visual features with convolutional neural networks without relying on annotations is a challenging and important task. Most recent efforts in unsupervised feature learning have focused on either small or highly…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Mathilde Caron , Piotr Bojanowski , Julien Mairal , Armand Joulin

Chest X-rays remain the primary diagnostic tool in emergency medicine, yet their limited ability to capture fine anatomical details can result in missed or delayed diagnoses. To address this, we introduce XVertNet, a novel deep-learning…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Ella Eidlin , Assaf Hoogi , Hila Rozen , Mohammad Badarne , Nathan S. Netanyahu

The framework is designed to improve performance in the analysis of combined as well as single anatomical perspectives for MRI disease diagnosis. It specifically addresses the performance degradation observed in state-of-the-art (SOTA)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Saif Ur Rehman Khan , Muhammad Nabeel Asim , Sebastian Vollmer , Andreas Dengel

Convolutional neural networks (CNNs) allow for parameter sharing and translational equivariance by using convolutional kernels in their linear layers. By restricting these kernels to be SO(3)-steerable, CNNs can further improve parameter…

Image and Video Processing · Electrical Eng. & Systems 2024-05-20 Ivan Diaz , Mario Geiger , Richard Iain McKinley

Purpose: To develop and evaluate the accuracy of a multi-view deep learning approach to the analysis of high-resolution synthetic mammograms from digital breast tomosynthesis screening cases, and to assess the effect on accuracy of image…

Image and Video Processing · Electrical Eng. & Systems 2020-09-29 Saeed Seyyedi , Margaret J. Wong , Debra M. Ikeda , Curtis P. Langlotz

The field of computational pathology has recently seen rapid advances driven by the development of modern vision foundation models (FMs), typically trained on vast collections of pathology images. Recent studies demonstrate that increasing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Mikhail Karasikov , Joost van Doorn , Nicolas Känzig , Melis Erdal Cesur , Hugo Mark Horlings , Robert Berke , Fei Tang , Sebastian Otálora