English
Related papers

Related papers: Modality Attention and Sampling Enables Deep Learn…

200 papers

We propose a method to facilitate exploration and analysis of new large data sets. In particular, we give an unsupervised deep learning approach to learning a latent representation that captures semantic similarity in the data set. The core…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Gary B Huang , Huei-Fang Yang , Shin-ya Takemura , Pat Rivlin , Stephen M Plaza

Fine-grained classification of microscopic image data with limited samples is an open problem in computer vision and biomedical imaging. Deep learning based vision systems mostly deal with high number of low-resolution images, whereas…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Mengran Fan , Tapabrata Chakrabort , Eric I-Chao Chang , Yan Xu , Jens Rittscher

Fluorescence microscopy has become a widely used tool for studying various biological structures of in vivo tissue or cells. However, quantitative analysis of these biological structures remains a challenge due to their complexity which is…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Soonam Lee , Chichen Fu , Paul Salama , Kenneth W. Dunn , Edward J. Delp

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

In biological research, fluorescence staining is a key technique to reveal the locations and morphology of subcellular structures. However, it is slow, expensive, and harmful to cells. In this paper, we model it as a deep learning task…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Donghao Zhou , Chunbin Gu , Junde Xu , Furui Liu , Qiong Wang , Guangyong Chen , Pheng-Ann Heng

We propose a cell segmentation method for analyzing images of densely clustered cells. The method combines the strengths of marker-controlled watershed transformation and a convolutional neural network (CNN). We demonstrate the method…

Image and Video Processing · Electrical Eng. & Systems 2020-04-06 Filip Lux , Petr Matula

In fluorescence microscopy, spectral unmixing aims to recover individual fluorophore concentrations from spectral images that capture mixed fluorophore emissions. Since classical methods operate pixel-wise and rely on least-squares fitting,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Federico Carrara , Talley Lambert , Mehdi Seifi , Florian Jug

Multi-modal magnetic resonance imaging (MRI) is essential in clinics for comprehensive diagnosis and surgical planning. Nevertheless, the segmentation of multi-modal MR images tends to be time-consuming and challenging. Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Cheng Li , Hui Sun , Zaiyi Liu , Meiyun Wang , Hairong Zheng , Shanshan Wang

In recent years, there has been increasing interest to incorporate attention into deep learning architectures for biomedical image segmentation. The modular design of attention mechanisms enables flexible integration into convolutional…

Image and Video Processing · Electrical Eng. & Systems 2021-11-02 Michael Yeung , Leonardo Rundo , Evis Sala , Carola-Bibiane Schönlieb , Guang Yang

Image segmentation is fundamental to microstructural analysis for defect identification and structure-property correlation, yet remains challenging due to pronounced heterogeneity in materials images arising from varied processing and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Sanjeev S. Navaratna , Nikhil Thawari , Gunashekhar Mari , Amritha V P , Murugaiyan Amirthalingam , Rohit Batra

The trade-off between throughput and image quality is an inherent challenge in microscopy. To improve throughput, compressive imaging under-samples image signals; the images are then computationally reconstructed by solving a regularized…

Image and Video Processing · Electrical Eng. & Systems 2023-03-07 Udith Haputhanthri , Andrew Seeber , Dushan Wadduwage

Supervised deep learning requires a large amount of training samples with annotations (e.g. label class for classification task, pixel- or voxel-wised label map for segmentation tasks), which are expensive and time-consuming to obtain.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yuanhan Mo , Shuo Wang , Chengliang Dai , Rui Zhou , Zhongzhao Teng , Wenjia Bai , Yike Guo

Semantic segmentation is one of the core tasks in the field of computer vision, and its goal is to accurately classify each pixel in an image. The traditional Unet model achieves efficient feature extraction and fusion through an…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Xuan Li , Quanchao Lu , Yankaiqi Li , Muqing Li , Yijiashun Qi

Fluorescence microscopy, while being a key driver for progress in the life sciences, is also subject to technical limitations. To overcome them, computational multiplexing techniques have recently been proposed, which allow multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Ashesh Ashesh , Florian Jug

This paper introduces a new method of data-driven microscope design for virtual fluorescence microscopy. Our results show that by including a model of illumination within the first layers of a deep convolutional neural network, it is…

Image and Video Processing · Electrical Eng. & Systems 2020-04-23 Colin L. Cooke , Fanjie Kong , Amey Chaware , Kevin C. Zhou , Kanghyun Kim , Rong Xu , D. Michael Ando , Samuel J. Yang , Pavan Chandra Konda , Roarke Horstmeyer

Large annotated datasets are crucial for the success of deep neural networks, but labeling data can be prohibitively expensive in domains such as medical imaging. This work tackles the subset selection problem: selecting a small set of the…

Machine Learning · Computer Science 2025-09-29 Noga Bar , Raja Giryes

Fluorescence microscopy has enabled a dramatic development in modern biology by visualizing biological organisms with micrometer scale resolution. However, due to the diffraction limit, sub-micron/nanometer features are difficult to…

Image and Video Processing · Electrical Eng. & Systems 2021-03-10 Varun Mannam , Yide Zhang , Xiaotong Yuan , Scott Howard

The combination of different imaging modalities into single imaging platforms has a strong potential in biomedical sciences since it permits the analysis of complementary properties of the target sample. Here, we report on an extremely…

Optics · Physics 2025-01-17 David Alonso , Javier Garcia , Vicente Mico

Deep learning models, including Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), have achieved state-of-the-art performance on various computer vision tasks such as object classification, detection, segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Vipul Arya , S. H. Shabbeer Basha , Srikrishna U N , Sunainha Vijay , Snehasis Mukherjee

Advancements in digital imaging technologies have sparked increased interest in using multiplexed immunofluorescence (mIF) images to visualise and identify the interactions between specific immunophenotypes with the tumour microenvironment…

Image and Video Processing · Electrical Eng. & Systems 2024-07-01 Piumi Sandarenu , Julia Chen , Iveta Slapetova , Lois Browne , Peter H. Graham , Alexander Swarbrick , Ewan K. A. Millar , Yang Song , Erik Meijering