English
Related papers

Related papers: ViTally Consistent: Scaling Biological Representat…

200 papers

Live cell culture is crucial in biomedical studies for analyzing cell properties and dynamics in vitro. This study focuses on segmenting unstained live cells imaged with bright-field microscopy. While many segmentation approaches exist for…

Quantitative Methods · Quantitative Biology 2025-08-26 Surajit Das , Gourav Roy , Pavel Zun

The widespread use of Magnetic Resonance Imaging (MRI) in combination with deep learning shows promise for many high-impact automated diagnostic and prognostic tools. However, training new models requires large amounts of labeled data, a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-24 Haoyu Dong , Yuwen Chen , Hanxue Gu , Nicholas Konz , Yaqian Chen , Qihang Li , Maciej A. Mazurowski

Neuroimaging of large populations is valuable to identify factors that promote or resist brain disease, and to assist diagnosis, subtyping, and prognosis. Data-driven models such as convolutional neural networks (CNNs) have increasingly…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Nikhil J. Dhinagar , Sophia I. Thomopoulos , Emily Laltoo , Paul M. Thompson

Electron microscopy has enabled many scientific breakthroughs across multiple fields. A key challenge is the tuning of microscope parameters based on images to overcome optical aberrations that deteriorate image quality. This calibration…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Jilles S. van Hulst , W. P. M. H. Heemels , Duarte J. Antunes

Cell detection in microscopy images is important to study how cells move and interact with their environment. Most recent deep learning-based methods for cell detection use convolutional neural networks (CNNs). However, inspired by the…

Image and Video Processing · Electrical Eng. & Systems 2022-06-15 Royden Wagner , Karl Rohr

Recent advances in computer vision and robotics enabled automated large-scale biological image analysis. Various machine learning approaches have been successfully applied to phenotypic profiling. However, it remains unclear how they…

Image and Video Processing · Electrical Eng. & Systems 2022-03-09 Andrei Dmitrenko , Mauro M. Masiero , Nicola Zamboni

Vision Transformers (ViTs) have achieved overwhelming success, yet they suffer from vulnerable resolution scalability, i.e., the performance drops drastically when presented with input resolutions that are unseen during training. We…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Rui Tian , Zuxuan Wu , Qi Dai , Han Hu , Yu Qiao , Yu-Gang Jiang

Learning robust representations to discriminate cell phenotypes based on microscopy images is important for drug discovery. Drug development efforts typically analyse thousands of cell images to screen for potential treatments. Early works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Alexis Perakis , Ali Gorji , Samriddhi Jain , Krishna Chaitanya , Simone Rizza , Ender Konukoglu

Recent advances in microscopy have enabled the rapid generation of terabytes of image data in cell biology and biomedical research. Vision-language models (VLMs) offer a promising solution for large-scale biological image analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Alejandro Lozano , Jeffrey Nirschl , James Burgess , Sanket Rajan Gupte , Yuhui Zhang , Alyssa Unell , Serena Yeung-Levy

Vision foundation models (FMs) are accelerating the development of digital pathology algorithms and transforming biomedical research. These models learn, in a self-supervised manner, to represent histological features in highly…

Generative models have emerged as powerful tools in medical imaging, enabling tasks such as segmentation, anomaly detection, and high-quality synthetic data generation. These models typically rely on learning meaningful latent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jordi Malé , Juan Fortea , Mateus Rozalem-Aranha , Neus Martínez-Abadías , Xavier Sevillano

High-throughput experimental techniques and bioinformatics tools make it possible to obtain reconstructions of the metabolism of microbial species. Combined with mathematical frameworks such as flux balance analysis, which assumes that…

Foundation models are reshaping computational pathology by enabling transfer learning, where models pre-trained on vast datasets can be adapted for downstream diagnostic, prognostic, and therapeutic response tasks. Despite these advances,…

Vision Transformers (ViT) is known for its scalability. In this work, we target to scale down a ViT to fit in an environment with dynamic-changing resource constraints. We observe that smaller ViTs are intrinsically the sub-networks of a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Yitian Zhang , Huseyin Coskun , Xu Ma , Huan Wang , Ke Ma , Xi , Chen , Derek Hao Hu , Yun Fu

Vision Transformers (ViTs) have emerged as the state-of-the-art architecture in representation learning, leveraging self-attention mechanisms to excel in various tasks. ViTs split images into fixed-size patches, constraining them to a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Aswathi Varma , Suprosanna Shit , Chinmay Prabhakar , Daniel Scholz , Hongwei Bran Li , Bjoern Menze , Daniel Rueckert , Benedikt Wiestler

Recent advancements in vision transformers (ViTs) have demonstrated that larger models often achieve superior performance. However, training these models remains computationally intensive and costly. To address this challenge, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Zhiwei Hao , Jianyuan Guo , Li Shen , Kai Han , Yehui Tang , Han Hu , Yunhe Wang

Current volumetric biomedical foundation models struggle to generalize as public 3D datasets are small and do not cover the broad diversity of medical procedures, conditions, anatomical regions, and imaging protocols. We address this by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Neel Dey , Benjamin Billot , Hallee E. Wong , Clinton J. Wang , Mengwei Ren , P. Ellen Grant , Adrian V. Dalca , Polina Golland

An important goal of self-supervised learning is to enable model pre-training to benefit from almost unlimited data. However, one method that has recently become popular, namely masked image modeling (MIM), is suspected to be unable to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhenda Xie , Zheng Zhang , Yue Cao , Yutong Lin , Yixuan Wei , Qi Dai , Han Hu

Cell instance segmentation is a fundamental task in digital pathology with broad clinical applications. Recently, vision foundation models, which are predominantly based on Vision Transformers (ViTs), have achieved remarkable success in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yang Yang , Xijie Xu , Yixun Zhou , Jie Zheng

The rapid development of Vision Foundation Models (VFMs), particularly Vision Transformers (ViT) and Segment Anything Model (SAM), has sparked significant advances in the field of medical image analysis. These models have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-02-24 Pengchen Liang , Bin Pu , Haishan Huang , Yiwei Li , Hualiang Wang , Weibo Ma , Qing Chang