English
Related papers

Related papers: M2ORT: Many-To-One Regression Transformer for Spat…

200 papers

Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell…

Quantitative Methods · Quantitative Biology 2026-02-17 Zhenglun Kong , Mufan Qiu , John Boesen , Xiang Lin , Sukwon Yun , Tianlong Chen , Manolis Kellis , Marinka Zitnik

This paper proposes a novel transformer-based model architecture for medical imaging problems involving analysis of vertebrae. It considers two applications of such models in MR images: (a) detection of spinal metastases and the related…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Rhydian Windsor , Amir Jamaludin , Timor Kadir , Andrew Zisserman

Segmenting multiple objects (e.g., organs) in medical images often requires an understanding of their topology, which simultaneously quantifies the shape of the objects and their positions relative to each other. This understanding is…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Mehmet Bahadir Erden , Sinan Unver , Ilke Ali Gurses , Rustu Turkay , Cigdem Gunduz-Demir

Synthetic lethality (SL) prediction is used to identify if the co-mutation of two genes results in cell death. The prevalent strategy is to abstract SL prediction as an edge classification task on gene nodes within SL data and achieve it…

Machine Learning · Computer Science 2023-10-18 Xusheng Zhao , Hao Liu , Qiong Dai , Hao Peng , Xu Bai , Huailiang Peng

The semantic segmentation task in pathology plays an indispensable role in assisting physicians in determining the condition of tissue lesions. With the proposal of Segment Anything Model (SAM), more and more foundation models have seen…

Image and Video Processing · Electrical Eng. & Systems 2024-09-05 Mingya Zhang , Liang Wang , Zhihao Chen , Yiyuan Ge , Xianping Tao

MRI and CT are essential clinical cross-sectional imaging techniques for diagnosing complex conditions. However, large 3D datasets with annotations for deep learning are scarce. While methods like DINOv2 are encouraging for 2D image…

Image and Video Processing · Electrical Eng. & Systems 2025-07-10 Gustav Müller-Franzes , Firas Khader , Robert Siepmann , Tianyu Han , Jakob Nikolas Kather , Sven Nebelung , Daniel Truhn

Spatial transcriptomics has the potential to transform our understanding of RNA expression in tissues. Classical array-based technologies produce multiple-cell-scale measurements requiring deconvolution to recover single cell information.…

In recent years, the integration of advanced imaging techniques and deep learning methods has significantly advanced computer-aided diagnosis (CAD) systems for breast cancer detection and classification. Transformers, which have shown great…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Mahtab Ranjbar , Mehdi Mohebbi , Mahdi Cherakhloo , Bijan Vosoughi. Vahdat

Single-shot magnetic resonance (MR) imaging acquires the entire k-space data in a single shot and it has various applications in whole-body imaging. However, the long acquisition time for the entire k-space in single-shot fast spin echo…

Image and Video Processing · Electrical Eng. & Systems 2024-09-13 Hemant Kumar Aggarwal , Sudhanya Chatterjee , Dattesh Shanbhag , Uday Patil , K. V. S. Hari

Spatial Transcriptomics (ST) is a method that captures gene expression profiles aligned with spatial coordinates. The discrete spatial distribution and the super-high dimensional sequencing results make ST data challenging to be modeled…

Machine Learning · Computer Science 2025-05-08 Qingtian Zhu , Yumin Zheng , Yuling Sang , Yifan Zhan , Ziyan Zhu , Jun Ding , Yinqiang Zheng

Prior works have proposed several strategies to reduce the computational cost of self-attention mechanism. Many of these works consider decomposing the self-attention procedure into regional and local feature extraction procedures that each…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ting Yao , Yehao Li , Yingwei Pan , Yu Wang , Xiao-Ping Zhang , Tao Mei

Inferring spatially resolved gene expression from histology images offers a cost-effective complement to spatial transcriptomics (ST). However, existing methods reduce this task to a simple morphology-to-expression mapping, where visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Junchao Zhu , Ruining Deng , Junlin Guo , Tianyuan Yao , Chongyu Qu , Juming Xiong , Zhengyi Lu , Yanfan Zhu , Marilyn Lionts , Yuechen Yang , Yu Wang , Shilin Zhao , Haichun Yang , Yuankai Huo

Gene expression estimation from pathology images has the potential to reduce the RNA sequencing cost. Point-wise loss functions have been widely used to minimize the discrepancy between predicted and absolute gene expression values.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Kazuya Nishimura , Haruka Hirose , Ryoma Bise , Kaito Shiku , Yasuhiro Kojima

Single-cell spatial transcriptomics (ST) offers a unique approach to measuring gene expression profiles and spatial cell locations simultaneously. However, most existing ST methods assume that cells in closer spatial proximity exhibit more…

Genomics · Quantitative Biology 2025-06-10 Xiongtao Xiao , Xiaofeng Chen , Feiyan Jiang , Songming Zhang , Wenming Cao , Cheng Tan , Zhangyang Gao , Zhongshan Li

A comprehensive three-dimensional (3D) map of tissue architecture and gene expression is crucial for illuminating the complexity and heterogeneity of tissues across diverse biomedical applications. However, most spatial transcriptomics (ST)…

Computational analysis of multiplexed immunofluorescence histology data is emerging as an important method for understanding the tumour micro-environment in cancer. This work presents HEMIT, a dataset designed for translating Hematoxylin…

Image and Video Processing · Electrical Eng. & Systems 2024-09-30 Chang Bian , Beth Philips , Tim Cootes , Martin Fergie

The dynamic nature of proteins is crucial for determining their biological functions and properties, for which Monte Carlo (MC) and molecular dynamics (MD) simulations stand as predominant tools to study such phenomena. By utilizing…

Quantitative Methods · Quantitative Biology 2024-03-13 Jiarui Lu , Bozitao Zhong , Zuobai Zhang , Jian Tang

In this work, we aim to address the challenging task of open set recognition (OSR). Many recent OSR methods rely on auto-encoders to extract class-specific features by a reconstruction strategy, requiring the network to restore the input…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Xin Sun , Henghui Ding , Chi Zhang , Guosheng Lin , Keck-Voon Ling

Image hiding is often referred to as steganography, which aims to hide a secret image in a cover image of the same resolution. Many steganography models are based on genera-tive adversarial networks (GANs) and variational autoencoders…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Chengde Lin , Xuezhu Gong , Shuxue Ding , Mingzhe Yang , Xijun Lu , Chengjun Mo

Multi-frequency Electrical Impedance Tomography (mfEIT) is a promising biomedical imaging technique that estimates tissue conductivities across different frequencies. Current state-of-the-art (SOTA) algorithms, which rely on supervised…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Hao Fang , Zhe Liu , Yi Feng , Zhen Qiu , Pierre Bagnaninchi , Yunjie Yang