English
Related papers

Related papers: ViTally Consistent: Scaling Biological Representat…

200 papers

Recently, plain vision Transformers (ViTs) have shown impressive performance on various computer vision tasks, thanks to their strong modeling capacity and large-scale pretraining. However, they have not yet conquered the problem of image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Jingfeng Yao , Xinggang Wang , Shusheng Yang , Baoyuan Wang

Machine learning models of vastly different modalities and architectures are being trained to predict the behavior of molecules, materials, and proteins. However, it remains unclear whether they learn similar internal representations of…

Machine Learning · Computer Science 2025-12-04 Sathya Edamadaka , Soojung Yang , Ju Li , Rafael Gómez-Bombarelli

Accurate classification of second-trimester fetal ultrasound images remains challenging due to low image quality, high intra-class variability, and significant class imbalance. In this work, we introduce a simple yet powerful, biologically…

Image and Video Processing · Electrical Eng. & Systems 2025-06-11 Rinat Prochii , Elizaveta Dakhova , Pavel Birulin , Maxim Sharaev

Spatial transcriptomics (ST) provides spatially resolved measurements of gene expression, enabling characterization of the molecular landscape of human tissue beyond histological assessment as well as localized readouts that can be aligned…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Konstantin Hemker , Andrew H. Song , Cristina Almagro-Pérez , Guillaume Jaume , Sophia J. Wagner , Anurag Vaidya , Nikola Simidjievski , Mateja Jamnik , Faisal Mahmood

Advances in deep learning models have revolutionized the study of biomolecule systems and their mechanisms. Graph representation learning, in particular, is important for accurately capturing the geometric information of biomolecules at…

Quantitative Methods · Quantitative Biology 2023-04-07 Xinye Xiong , Bingxin Zhou , Yu Guang Wang

Computational pathology models that use digitized histopathology whole-slide images have the potential to become a cost-effective and scalable alternative to molecular assays for the prediction of genomic biomarkers, a key task in precision…

Quantitative Methods · Quantitative Biology 2026-03-03 Ekaterina Redekop , Eric Zimmermann , Ava P Amini , Alex X Lu , Neil Tenenholtz , James Brian Hall , Lorin Crawford , Kristen A Severson

Predicting the response of a patient to a cancer treatment is of high interest. Nonetheless, this task is still challenging from a medical point of view due to the complexity of the interaction between the patient organism and the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Bilel Guetarni , Feryal Windal , Halim Benhabiles , Mahfoud Chaibi , Romain Dubois , Emmanuelle Leteurtre , Dominique Collard

We propose ViC-MAE, a model that combines both Masked AutoEncoders (MAE) and contrastive learning. ViC-MAE is trained using a global featured obtained by pooling the local representations learned under an MAE reconstruction loss and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Jefferson Hernandez , Ruben Villegas , Vicente Ordonez

Vision models pretrained on large-scale RGB natural image datasets are widely reused for electron microscopy image segmentation. In electron microscopy, volumetric data are acquired as serial sections and processed as stacks of adjacent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Zsófia Molnár , Gergely Szabó , András Horváth

We present an extension to masked autoencoders (MAE) which improves on the representations learnt by the model by explicitly encouraging the learning of higher scene-level features. We do this by: (i) the introduction of a perceptual…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Samyakh Tukra , Frederick Hoffman , Ken Chatfield

In the field of deep learning, large architectures often obtain the best performance for many tasks, but also require massive datasets. In the histological domain, tissue images are expensive to obtain and constitute sensitive medical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Andrei-Alexandru Preda , Iulian-Marius Tăiatu , Dumitru-Clementin Cercel

Spatial variable genes (SVGs) reveal critical information about tissue architecture, cellular interactions, and disease microenvironments. As spatial transcriptomics (ST) technologies proliferate, accurately identifying SVGs across diverse…

Applications · Statistics 2025-10-21 Jiawen Chen , Jinwei Zhang , Dongshen Peng , Yutong Song , Aitong Ruan , Yun Li , Didong Li

Given the crucial role of microtubules for cell survival, many researchers have found success using microtubule-targeting agents in the search for effective cancer therapeutics. Understanding microtubule responses to targeted interventions…

Image and Video Processing · Electrical Eng. & Systems 2019-10-03 Hao-Chih Lee , Sarah T Cherng , Riccardo Miotto , Joel T Dudley

In the image classification task, the most common approach is to resize all images in a dataset to a unique shape, while reducing their precision to a size which facilitates experimentation at scale. This practice has benefits from a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Ferran Parés , Anna Arias-Duart , Dario Garcia-Gasulla , Gema Campo-Francés , Nina Viladrich , Eduard Ayguadé , Jesús Labarta

Large scale visual understanding is challenging, as it requires a model to handle the widely-spread and imbalanced distribution of <subject, relation, object> triples. In real-world scenarios with large numbers of objects and relations,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Ji Zhang , Yannis Kalantidis , Marcus Rohrbach , Manohar Paluri , Ahmed Elgammal , Mohamed Elhoseiny

Surgical video understanding is essential for computer-assisted interventions, yet existing surgical foundation models remain constrained by limited data scale, procedural diversity, and inconsistent evaluation, often lacking a reproducible…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Sicheng Lu , Zikai Xiao , Jianhui Wei , Danyu Sun , Qi Lu , Keli Hu , Yang Feng , Jian Wu , Zongxin Yang , Zuozhu Liu

Foundation models leverage large-scale pretraining to capture extensive knowledge, demonstrating generalization in a wide range of language tasks. By comparison, vision foundation models (VFMs) often exhibit uneven improvements across…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shiqi Huang , Yipei Wang , Natasha Thorley , Alexander Ng , Shaheer Saeed , Mark Emberton , Shonit Punwani , Veeru Kasivisvanathan , Dean Barratt , Daniel Alexander , Yipeng Hu

Although Vision Transformers (ViTs) have recently advanced computer vision tasks significantly, an important real-world problem was overlooked: adapting to variable input resolutions. Typically, images are resized to a fixed resolution,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Wenzhuo Liu , Fei Zhu , Shijie Ma , Cheng-Lin Liu

Transfer of pre-trained representations improves sample efficiency and simplifies hyperparameter tuning when training deep neural networks for vision. We revisit the paradigm of pre-training on large supervised datasets and fine-tuning the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Alexander Kolesnikov , Lucas Beyer , Xiaohua Zhai , Joan Puigcerver , Jessica Yung , Sylvain Gelly , Neil Houlsby

Deep learning has led to state-of-the-art results for many medical imaging tasks, such as segmentation of different anatomical structures. With the increased numbers of deep learning publications and openly available code, the approach to…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Tom van Sonsbeek , Veronika Cheplygina