English
Related papers

Related papers: Intermediate Layers Encode Optimal Biological Repr…

200 papers

Vision-Language Encoders (VLEs) are widely adopted as the backbone of zero-shot referring image segmentation (RIS), enabling text-guided localization without task-specific training. However, prior works underexplored the underlying biases…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Na Min An , Inha Kang , Minhyun Lee , Hyunjung Shim

Deep learning models have been efficient lately on image parsing tasks. However, deep learning models are not fully capable of exploiting visual and contextual information simultaneously. The proposed three-layer context-based deep…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ranju Mandal , Basim Azam , Brijesh Verma

Accurate molecular property prediction is central to drug discovery, catalysis, and process design, yet real-world applications are often limited by small datasets. Molecular foundation models provide a promising direction by learning…

Machine Learning · Computer Science 2026-04-21 Karim K. Ben Hicham , Jan G. Rittig , Martin Grohe , Alexander Mitsos

Pathology foundation models (PFMs) have emerged as a core approach for learning transferable representations from whole slide images (WSIs), and they are typically benchmarked through downstream clinical endpoints. While such task level…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bokai Zhao , Yiyang Zhang , Yuanchi Zhu , Hanqing Chao , Long Bai , Tai Ma , Minfeng Xu , Ming Song , Tianzi Jiang

We show that for a variety of concepts in adapter-based vision-language models, the representations of their images and their text descriptions are meaningfully aligned from the very first layer. This contradicts the established view that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Evžen Wybitul , Javier Rando , Florian Tramèr , Stanislav Fort

The upper mid-band balances coverage and capacity for the future cellular systems and also embraces XL-MIMO systems, offering enhanced spectral and energy efficiency. However, these benefits are significantly degraded under mobility due to…

Signal Processing · Electrical Eng. & Systems 2025-08-13 Hongwei Hou , Yafei Wang , Xinping Yi , Wenjin Wang , Dirk T. M. Slock , Shi Jin

Computational models have become an essential part of exploratory protocols in cell biology, as a complement to in vivo or in vitro experiments. These virtual models have the twofold advantage of enabling access to new types of data and…

Medical Physics · Physics 2021-12-20 Maxime Vassaux , Laurent Pieuchot , Karine Anselme , Maxence Bigerelle , Jean-Louis Milan

Next-token predictors often appear to develop internal representations of the latent world and its rules. The probabilistic nature of these models suggests a deep connection between the structure of the world and the geometry of probability…

Machine Learning · Computer Science 2026-03-18 Sasha Brenner , Thomas R. Knösche , Nico Scherf

We present an extension to masked autoencoders (MAE) which improves on the representations learnt by the model by explicitly encouraging the learning of higher scene-level features. We do this by: (i) the introduction of a perceptual…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Samyakh Tukra , Frederick Hoffman , Ken Chatfield

Several recent Transformer architectures expose later layers to representations computed in the earliest layers, motivated by the observation that low-level features can become harder to recover as the residual stream is repeatedly…

Machine Learning · Computer Science 2026-05-07 Skye Gunasekaran , Téa Wright , Rui-Jie Zhu , Jason Eshraghian

Predicting transcriptional responses to novel drugs provides a unique opportunity to accelerate biomedical research and advance drug discovery efforts. However, the inherent complexity and high dimensionality of cellular responses, combined…

Large-scale multi-relational embedding refers to the task of learning the latent representations for entities and relations in large knowledge graphs. An effective and scalable solution for this problem is crucial for the true success of…

Machine Learning · Computer Science 2017-07-07 Hanxiao Liu , Yuexin Wu , Yiming Yang

We consider the problem of embedding character-entity relationships from the reduced semantic space of narratives, proposing and evaluating the assumption that these relationships hold under a reflection operation. We analyze this…

Computation and Language · Computer Science 2022-12-22 Mikolaj Figurski

Single-cell RNA-seq data analysis typically requires representations that capture heterogeneous local structure across multiple scales while remaining stable and interpretable. In this work, we propose a hierarchical sheaf spectral…

Machine Learning · Computer Science 2026-03-31 Xiang Xiang Wang , Guo-Wei We

The cells and their spatial patterns in the tumor microenvironment (TME) play a key role in tumor evolution, and yet the latter remains an understudied topic in computational pathology. This study, to the best of our knowledge, is among the…

Quantitative Methods · Quantitative Biology 2021-09-21 Pingjun Chen , Muhammad Aminu , Siba El Hussein , Joseph D. Khoury , Jia Wu

Two questions regarding practitioners' use of patent embeddings arise: (i) Does one fine-tuning recipe suffice for all downstream applications? (ii) Is fine-tuning on one patent landscape sufficient for downstream application on other…

Information Retrieval · Computer Science 2026-05-27 Amirhossein Yousefiramandi , Ciaran Cooney

In recent years, a standard computational pathology workflow has emerged where whole slide images are cropped into tiles, these tiles are processed using a foundation model, and task-specific models are built using the resulting…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Eric Zimmermann , Julian Viret , Michal Zelechowski , James Brian Hall , Neil Tenenholtz , Adam Casson , George Shaikovski , Eugene Vorontsov , Siqi Liu , Kristen A Severson

Cancer progression arises from interactions across multiple biological layers, especially beyond morphological and across molecular layers that remain invisible to image-only models. To capture this broader biological landscape, we present…

Machine Learning · Computer Science 2025-12-17 Juseung Yun , Sunwoo Yu , Sumin Ha , Jonghyun Kim , Janghyeon Lee , Jongseong Jang , Soonyoung Lee

Accurate delineation of individual cells in microscopy videos is essential for studying cellular dynamics, yet separating touching or overlapping instances remains a persistent challenge. Although foundation-model for segmentation such as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Thomas Mendelson , Joshua Francois , Galit Lahav , Tammy Riklin-Raviv

Foundation models have recently emerged as powerful feature extractors in computational pathology, yet they typically omit mechanisms for leveraging the global spatial structure of tissues and the local contextual relationships among…