English
Related papers

Related papers: scFusionTTT: Single-cell transcriptomics and prote…

200 papers

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Spatial transcriptomics (ST) enables transcriptome-wide profiling while preserving the spatial context of tissues, offering unprecedented opportunities to study tissue organization and cell-cell interactions in situ. Despite recent…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Wei Wang , Quoc-Toan Ly , Chong Yu , Jun Bai

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Contrastive, self-supervised learning (SSL) is used to train a model that predicts cancer type from miRNA, mRNA or RPPA expression data. This model, a pretrained FT-Transformer, is shown to outperform XGBoost and CatBoost, standard…

Machine Learning · Computer Science 2023-11-17 Christian John Hurry , Emma Slade

Due to the high heterogeneity and clinical characteristics of cancer, there are significant differences in multi-omic data and clinical characteristics among different cancer subtypes. Therefore, accurate classification of cancer subtypes…

Quantitative Methods · Quantitative Biology 2023-08-23 Liangrui Pan , Dazheng Liu , Zhichao Feng , Wenjuan Liu , Shaoliang Peng

Over the past decade, the revolution in single-cell sequencing has enabled the simultaneous molecular profiling of various modalities across thousands of individual cells, allowing scientists to investigate the diverse functions of complex…

Computation and Language · Computer Science 2024-12-05 Junhao Liu , Siwei Xu , Lei Zhang , Jing Zhang

Multi-task learning (MTL) paradigm focuses on jointly learning two or more tasks, aiming for significant improvement w.r.t model's generalizability, performance, and training/inference memory footprint. The aforementioned benefits become…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Nitin Bansal , Pan Ji , Junsong Yuan , Yi Xu

Recently developed technologies to generate single-cell genomic data have made a revolutionary impact in the field of biology. Multi-omics assays offer even greater opportunities to understand cellular states and biological processes.…

Genomics · Quantitative Biology 2022-01-19 Stefan Stanojevic , Yijun Li , Lana X. Garmire

Multimodal sentiment analysis utilizes multiple heterogeneous modalities for sentiment classification. The recent multimodal fusion schemes customize LSTMs to discover intra-modal dynamics and design sophisticated attention mechanisms to…

Artificial Intelligence · Computer Science 2020-10-19 Sunny Verma , Jiwei Wang , Zhefeng Ge , Rujia Shen , Fan Jin , Yang Wang , Fang Chen , Wei Liu

Single-cell proteomics (SCP) is transforming our understanding of biological complexity by shifting from bulk proteomics, where signals are averaged over thousands of cells, to the proteome analysis of individual cells. This granular…

Quantitative Methods · Quantitative Biology 2025-04-01 Amanda Momenzadeh , Jesse G. Meyer

The integration of single-cell proteomic data is often hindered by the fragmented nature of targeted antibody panels. To address this limitation, we introduce scpFormer, a transformer-based foundation model designed for single-cell…

Quantitative Methods · Quantitative Biology 2026-04-23 Qifeng Zhou , Lei Yu , Yuzhi Guo , Yuwei Miao , Hehuan Ma , Wenliang Zhong , Lin Xu , Junzhou Huang

Deploying models on target domain data subject to distribution shift requires adaptation. Test-time training (TTT) emerges as a solution to this adaptation under a realistic scenario where access to full source domain data is not available,…

Machine Learning · Computer Science 2023-03-21 Yongyi Su , Xun Xu , Tianrui Li , Kui Jia

Accurate, noninvasive glioma characterization is crucial for effective clinical management. Traditional methods, dependent on invasive tissue sampling, often fail to capture the spatial heterogeneity of the tumor. While deep learning has…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Somayeh Farahani , Marjaneh Hejazi , Antonio Di Ieva , Emad Fatemizadeh , Sidong Liu

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning. Although models based on convolutional neural networks (CNNs) and Transformers have achieved remarkable success in medical image segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Jiashu Xu

Biomedical image segmentation is crucial for accurately diagnosing and analyzing various diseases. However, Convolutional Neural Networks (CNNs) and Transformers, the most commonly used architectures for this task, struggle to effectively…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Rong Zhou , Zhengqing Yuan , Zhiling Yan , Weixiang Sun , Kai Zhang , Yiwei Li , Yanfang Ye , Xiang Li , Lifang He , Lichao Sun

The analysis of physiological processes over time are often given by spectrometric or gene expression profiles over time with only few time points but a large number of measured variables. The analysis of such temporal sequences is…

Machine Learning · Computer Science 2011-10-12 F. -M. Schleif , A. Gisbrecht , B. Hammer

Multi-modal learning plays a crucial role in cancer diagnosis and prognosis. Current deep learning based multi-modal approaches are often limited by their abilities to model the complex correlations between genomics and histology data,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Yupei Zhang , Xiaofei Wang , Fangliangzi Meng , Jin Tang , Chao Li

Cancer subtype classification is crucial for personalized treatment and prognostic assessment. However, effectively integrating multi-omic data remains challenging due to the heterogeneous nature of genomic, epigenomic, and transcriptomic…

Machine Learning · Computer Science 2025-06-10 Sajib Acharjee Dip , Uddip Acharjee Shuvo , Dipanwita Mallick , Abrar Rahman Abir , Liqing Zhang

Muilti-modality data are ubiquitous in biology, especially that we have entered the multi-omics era, when we can measure the same biological object (cell) from different aspects (omics) to provide a more comprehensive insight into the…

Genomics · Quantitative Biology 2021-12-15 Xuesong Wang , Zhihang Hu , Tingyang Yu , Ruijie Wang , Yumeng Wei , Juan Shu , Jianzhu Ma , Yu Li

Phenotyping is the process of distinguishing groups of patients to identify different types of disease progression. A recent trend employs low-rank matrix and tensor factorization methods for their capability of dealing with multi-modal,…

Machine Learning · Computer Science 2025-06-26 Cristian Minoccheri , Sophia Tesic , Kayvan Najarian , Ryan Stidham