English
Related papers

Related papers: Scaling up self-supervised learning for improved s…

200 papers

Traditional supervised 3D medical image segmentation models need voxel-level annotations, which require huge human effort, time, and cost. Semi-supervised learning (SSL) addresses this limitation of supervised learning by facilitating…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Suruchi Kumari , Aryan Das , Swalpa Kumar Roy , Indu Joshi , Pravendra Singh

Background and objective: Cell-level pathological image analysis requires working with extremely small image patches (40x40 pixels), far below standard ImageNet resolutions. It remains unclear whether modern deep learning architectures and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Hiroki Kagiyama , Toru Nagasaka , Yukari Adachi , Takaaki Tachibana , Ryota Ito , Mitsugu Fujita , Kimihiro Yamashita , Yoshihiro Kakeji

Convolutional networks are at the core of most state-of-the-art computer vision solutions for a wide variety of tasks. Since 2014 very deep convolutional networks started to become mainstream, yielding substantial gains in various…

Computer Vision and Pattern Recognition · Computer Science 2015-12-14 Christian Szegedy , Vincent Vanhoucke , Sergey Ioffe , Jonathon Shlens , Zbigniew Wojna

Pre-trained machine learning (ML) models have shown great performance for a wide range of applications, in particular in natural language processing (NLP) and computer vision (CV). Here, we study how pre-training could be used for…

Machine Learning · Computer Science 2024-01-05 Shashank Subramanian , Peter Harrington , Kurt Keutzer , Wahid Bhimji , Dmitriy Morozov , Michael Mahoney , Amir Gholami

Surgical phase recognition is a critical component for context-aware decision support in intelligent operating rooms, yet training robust models is hindered by limited annotated clinical videos and large domain gaps between synthetic and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yuxin He , An Li , Cheng Xue

Material classification has emerged as a critical task in computer vision and graphics, supporting the assignment of accurate material properties to a wide range of digital and real-world applications. While traditionally framed as an image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Qingran Lin , Fengwei Yang , Chaolun Zhu

Recent advancements in self-supervised learning have led to powerful surgical vision encoders capable of spatiotemporal understanding. However, extending these visual foundations to multi-modal reasoning tasks is severely bottlenecked by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Chengan Che , Chao Wang , Jiayuan Huang , Xinyue Chen , Luis C. Garcia-Peraza-Herrera

Self-supervised pre-training medical foundation models on large-scale datasets demonstrate exceptional performance. Recent research challenges this common paradigm by introducing data-effective learning approaches, demonstrating that merely…

Machine Learning · Computer Science 2025-04-08 Wenxuan Yang , Hanyu Zhang , Weimin Tan , Yuqi Sun , Bo Yan

The rise of imaging techniques such as optical coherence tomography (OCT) and advances in deep learning (DL) have enabled clinicians and researchers to streamline retinal disease staging. A popular DL approach is self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Ronald Fecso , José Morano , Ursula Schmidt-Erfurth , Hrvoje Bogunović

Large pre-trained models with their numerous model parameters and extensive training datasets have shown excellent performance in various tasks. Many publicly available medical image datasets do not have a sufficient amount of data so there…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Jianhao Xie , Ziang Zhang , Guibo Luo , Yuesheng Zhu

Super-resolution ultrasound imaging (SRUS) is an active area of research as it brings up to a ten-fold improvement in the resolution of microvascular structures. The limitations to the clinical adoption of SRUS include long acquisition…

Image and Video Processing · Electrical Eng. & Systems 2024-08-05 Arthur David Redfern , Katherine G. Brown

It is a challenging task to accurately perform semantic segmentation due to the complexity of real picture scenes. Many semantic segmentation methods based on traditional deep learning insufficiently captured the semantic and appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Haitong Tang , Shuang He , Mengduo Yang , Xia Lu , Qin Yu , Kaiyue Liu , Hongjie Yan , Nizhuan Wang

Vision Transformers have been rapidly uprising in computer vision thanks to their outstanding scaling trends, and gradually replacing convolutional neural networks (CNNs). Recent works on self-supervised learning (SSL) introduce siamese…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Tianjin Huang , Tianlong Chen , Zhangyang Wang , Shiwei Liu

Deep learning underlies most modern approaches and tools in computer vision, including biomedical imaging. However, for interactive semantic segmentation (often called pixel classification in this context) and interactive object-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Carolin Teuber , Anwai Archit , Tobias Boothe , Peter Ditte , Jochen Rink , Constantin Pape

Computed Tomography (CT) imaging technique is widely used in geological exploration, medical diagnosis and other fields. In practice, however, the resolution of CT image is usually limited by scanning devices and great expense. Super…

Computer Vision and Pattern Recognition · Computer Science 2020-01-29 Yukai Wang , Qizhi Teng , Xiaohai He , Junxi Feng , Tingrong Zhang

Medical image segmentation models are typically optimised with voxel-wise losses that constrain predictions only in the output space. This leaves latent feature representations largely unconstrained, potentially limiting generalisation. We…

Image and Video Processing · Electrical Eng. & Systems 2026-03-02 Puru Vaish , Amin Ranem , Felix Meister , Tobias Heimann , Christoph Brune , Jelmer M. Wolterink

Surgical scene perception via videos is critical for advancing robotic surgery, telesurgery, and AI-assisted surgery, particularly in ophthalmology. However, the scarcity of diverse and richly annotated video datasets has hindered the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Ming Hu , Peng Xia , Lin Wang , Siyuan Yan , Feilong Tang , Zhongxing Xu , Yimin Luo , Kaimin Song , Jurgen Leitner , Xuelian Cheng , Jun Cheng , Chi Liu , Kaijing Zhou , Zongyuan Ge

Standard convolutional neural networks(CNNs) require consistent image resolutions in both training and testing phase. However, in practice, testing with smaller image sizes is necessary for fast inference. We show that trivially evaluating…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Zhuoran Yu , Aojun Zhou , Yukun Ma , Yudian Li , Xiaohan Zhang , Ping Luo

With the inspiration of vision transformers, the concept of depth-wise convolution revisits to provide a large Effective Receptive Field (ERF) using Large Kernel (LK) sizes for medical image segmentation. However, the segmentation…

Image and Video Processing · Electrical Eng. & Systems 2023-06-07 Ho Hin Lee , Quan Liu , Shunxing Bao , Qi Yang , Xin Yu , Leon Y. Cai , Thomas Li , Yuankai Huo , Xenofon Koutsoukos , Bennett A. Landman

The clinical adoption of artificial intelligence (AI) in medical imaging requires models that are both diagnostically accurate and interpretable to clinicians. While current multimodal biomedical foundation models prioritize performance,…