English
Related papers

Related papers: Efficient Pretraining Model based on Multi-Scale L…

200 papers

Energy-based models (EBMs) exhibit a variety of desirable properties in predictive tasks, such as generality, simplicity and compositionality. However, training EBMs on high-dimensional datasets remains unstable and expensive. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Xiulong Yang , Shihao Ji

Conventional deep learning models deal with images one-by-one, requiring costly and time-consuming expert labeling in the field of medical imaging, and domain-specific restriction limits model generalizability. Visual in-context learning…

In this study, we introduce an innovative EEG signal reconstruction sub-module designed to enhance the performance of deep learning models on EEG eye-tracking tasks. This sub-module can integrate with all Encoder-Classifier-based deep…

Human-Computer Interaction · Computer Science 2024-08-13 Weigeng Li , Neng Zhou , Xiaodong Qu

Scanning transmission electron microscopy (STEM) is an extremely versatile method for studying materials on the atomic scale. Many STEM experiments are supported or validated with electron scattering simulations. However, using the…

Traditional model-based image reconstruction (MBIR) methods combine forward and noise models with simple object priors. Recent application of deep learning methods for image reconstruction provides a successful data-driven approach to…

Image and Video Processing · Electrical Eng. & Systems 2022-05-20 Ling Chen , Zhishen Huang , Yong Long , Saiprasad Ravishankar

The main focus of this work is a novel framework for the joint reconstruction and segmentation of parallel MRI (PMRI) brain data. We introduce an image domain deep network for calibrationless recovery of undersampled PMRI data. The proposed…

Image and Video Processing · Electrical Eng. & Systems 2021-02-03 Aniket Pramanik , Mathews Jacob

In the field of materials science, microscopy is the first and often only accessible method for structural characterization. There is a growing interest in the development of machine learning methods that can automate the analysis and…

Materials Science · Physics 2022-09-28 Shizhao Lu , Brian Montz , Todd Emrick , Arthi Jayaraman

Image reconstruction of low-count positron emission tomography (PET) data is challenging. Kernel methods address the challenge by incorporating image prior information in the forward model of iterative PET image reconstruction. The…

Image and Video Processing · Electrical Eng. & Systems 2022-10-25 Siqi Li , Kuang Gong , Ramsey D. Badawi , Edward J. Kim , Jinyi Qi , Guobao Wang

We introduce Correlational Image Modeling (CIM), a novel and surprisingly effective approach to self-supervised visual pre-training. Our CIM performs a simple pretext task: we randomly crop image regions (exemplars) from an input image…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wei Li , Jiahao Xie , Chen Change Loy

We introduce a new image segmentation task, called Entity Segmentation (ES), which aims to segment all visual entities (objects and stuffs) in an image without predicting their semantic labels. By removing the need of class label…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Lu Qi , Jason Kuen , Yi Wang , Jiuxiang Gu , Hengshuang Zhao , Zhe Lin , Philip Torr , Jiaya Jia

Medical image segmentation is crucial for disease diagnosis and treatment planning, yet developing robust segmentation models often requires substantial computational resources and large datasets. Existing research shows that pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Paul Zaha , Lars Böcking , Simeon Allmendinger , Leopold Müller , Niklas Kühl

Segmentation is an important analysis task for biomedical images, enabling the study of individual organelles, cells or organs. Deep learning has massively improved segmentation methods, but challenges remain in generalization to new…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Carolin Teuber , Anwai Archit , Constantin Pape

Multi-label recognition with partial labels (MLR-PL), in which only some labels are known while others are unknown for each image, is a practical task in computer vision, since collecting large-scale and complete multi-label datasets is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Haoxian Ruan , Zhihua Xu , Zhijing Yang , Yongyi Lu , Jinghui Qin , Tianshui Chen

This paper proposes a novel self-supervised learning method for semantic segmentation using selective masking image reconstruction as the pretraining task. Our proposed method replaces the random masking augmentation used in most masked…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yuemin Wang , Ian Stavness

Masked Image Modeling (MIM) has emerged as a promising method for deriving visual representations from unlabeled image data by predicting missing pixels from masked portions of images. It excels in region-aware learning and provides strong…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yibing Wei , Abhinav Gupta , Pedro Morgado

Accurately segmenting different organs from medical images is a critical prerequisite for computer-assisted diagnosis and intervention planning. This study proposes a deep learning-based approach for segmenting various organs from CT and…

Semi-supervised learning has greatly advanced medical image segmentation since it effectively alleviates the need of acquiring abundant annotations from experts and utilizes unlabeled data which is much easier to acquire. Among existing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Yuyan Shi , Yichi Zhang , Shasha Wang

The recent development of light-weighted neural networks has promoted the applications of deep learning under resource constraints and mobile applications. Many of these applications need to perform a real-time and efficient prediction for…

Computer Vision and Pattern Recognition · Computer Science 2020-06-05 Weihao Jiang , Zhaozhi Xie , Yaoyi Li , Chang Liu , Hongtao Lu

Massively multilingual sentence representation models, e.g., LASER, SBERT-distill, and LaBSE, help significantly improve cross-lingual downstream tasks. However, the use of a large amount of data or inefficient model architectures results…

Computation and Language · Computer Science 2024-05-31 Zhuoyuan Mao , Chenhui Chu , Sadao Kurohashi

Differentiable rendering has been widely adopted in computer graphics as a powerful approach to inverse problems, enabling efficient gradient-based optimization by differentiating the image formation process with respect to millions of…