English
Related papers

Related papers: Structural Prognostic Event Modeling for Multimoda…

200 papers

Characterizing the long term behavior of dynamical systems given limited measurements is a common challenge throughout the physical and biological sciences. This is a challenging task due to the sparsity and noise inherent to empirical…

Machine Learning · Computer Science 2026-03-10 Roy Friedman , Noa Moriel , Matthew Ricci , Guy Pelc , Yair Weiss , Mor Nitzan

We introduce ProtoPathway, an interpretable-by-design multimodal framework for cancer survival prediction that unifies whole slide imaging and transcriptomics through encoders producing biologically grounded representations on both sides of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Amaya Gallagher-Syed , Costantino Pitzalis , Myles J. Lewis , Michael R. Barnes , Gregory Slabaugh

The accurate segmentation of medical images is a crucial step in obtaining reliable morphological statistics. However, training a deep neural network for this task requires a large amount of labeled data to ensure high-accuracy results. To…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Xianjun Han , Qianqian Chen , Zhaoyang Xie , Xuejun Li , Hongyu Yang

Deep-learning-based clinical decision support using structured electronic health records (EHR) has been an active research area for predicting risks of mortality and diseases. Meanwhile, large amounts of narrative clinical notes provide…

Computation and Language · Computer Science 2023-05-10 Weimin Lyu , Xinyu Dong , Rachel Wong , Songzhu Zheng , Kayley Abell-Hart , Fusheng Wang , Chao Chen

Addressing the challenge of multimodal data fusion in high-dimensional biomedical informatics, we propose MMCTOP, a MultiModal Clinical-Trial Outcome Prediction framework that integrates heterogeneous biomedical signals spanning (i)…

Machine Learning · Computer Science 2025-12-29 Carolina Aparício , Qi Shi , Bo Wen , Tesfaye Yadete , Qiwei Han

Tumour heterogeneity in breast cancer poses challenges in predicting outcome and response to therapy. Spatial transcriptomics technologies may address these challenges, as they provide a wealth of information about gene expression at the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-19 Md Mamunur Rahaman , Ewan K. A. Millar , Erik Meijering

Multimodal learning that integrates histopathology images and genomic data holds great promise for cancer survival prediction. However, existing methods face key limitations: 1) They rely on multimodal mapping and metrics in Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Jiaqi Yang , Wenting Chen , Xiaohan Xing , Sean He , Xiaoling Luo , Xinheng Lyu , Linlin Shen , Guoping Qiu

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Pathological images play an essential role in cancer prognosis, while survival analysis, which integrates computational techniques, can predict critical clinical events such as patient mortality or disease recurrence from whole-slide images…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Guo Tang , Songhan Jiang , Jinpeng Lu , Linghan Cai , Yongbing Zhang

Understanding the dynamic nature of protein structures is essential for comprehending their biological functions. While significant progress has been made in predicting static folded structures, modeling protein motions on microsecond to…

This study introduces an integrated framework for predictive causal inference designed to overcome limitations inherent in conventional single model approaches. Specifically, we combine a Hidden Markov Model (HMM) for spatial health state…

Methodology · Statistics 2025-10-31 Byunghee Lee , Hye Yeon Sin , Joonsung Kang

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev

Reliable forward uncertainty quantification in engineering requires methods that account for aleatory and epistemic uncertainties. In many applications, epistemic effects arising from uncertain parameters and model form dominate prediction…

Computational Engineering, Finance, and Science · Computer Science 2025-12-18 Akash Yadav , Ruda Zhang

Osteoporosis is a common condition that increases fracture risk, especially in older adults. Early diagnosis is vital for preventing fractures, reducing treatment costs, and preserving mobility. However, healthcare providers face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Mehdi Hosseini Chagahi , Saeed Mohammadi Dashtaki , Niloufar Delfan , Nadia Mohammadi , Farshid Rostami Pouria , Behzad Moshiri , Md. Jalil Piran , Oliver Faust

Cancer survival prediction is a challenging task that involves analyzing of the tumor microenvironment within Whole Slide Image (WSI). Previous methods cannot effectively capture the intricate interaction features among instances within the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Zekang Yang , Hong Liu , Xiangdong Wang

Human pose estimation focuses on predicting body keypoints to analyze human motion. Currently, most pose estimation tasks rely on conventional RGB cameras. In contrast, event cameras provide high temporal resolution and low latency,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Haoxian Zhou , Chuanzhi Xu , Langyi Chen , Pengfei Ye , Haodong Chen , Yuk Ying Chung , Qiang Qu

We investigate spatio-temporal event analysis using point processes. Inferring the dynamics of event sequences spatiotemporally has many practical applications including crime prediction, social media analysis, and traffic forecasting. In…

Machine Learning · Computer Science 2021-02-17 Fatih Ilhan , Suleyman Serdar Kozat

Accurately predicting the survival of cancer patients is crucial for personalized treatment. However, existing studies focus solely on the relationships between samples with known survival risks, without fully leveraging the value of…

Machine Learning · Computer Science 2025-07-23 Hailin Yue , Hulin Kuang , Jin Liu , Junjian Li , Lanlan Wang , Mengshen He , Jianxin Wang

Multimodal pathology-genomic analysis has become increasingly prominent in cancer survival prediction. However, existing studies mainly utilize multi-instance learning to aggregate patch-level features, neglecting the information loss of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Mingcheng Qu , Guang Yang , Donglin Di , Tonghua Su , Yue Gao , Yang Song , Lei Fan

Stochastic embedding transitions introduce a probabilistic mechanism for adjusting token representations dynamically during inference, mitigating the constraints imposed through static or deterministic embeddings. A transition framework was…

Computation and Language · Computer Science 2025-08-11 Stefan Whitaker , Colin Sisate , Marcel Windsor , Nikolai Fairweather , Tarquin Goldborough , Oskar Lindenfeld