English
Related papers

Related papers: PyTDC: A multimodal machine learning training, eva…

200 papers

The Cancer Genome Atlas (TCGA) has enabled novel discoveries and served as a large-scale reference dataset in cancer through its harmonized genomics, clinical, and imaging data. Numerous prior studies have developed bespoke deep learning…

Machine Learning · Computer Science 2026-05-11 Steven Song , Morgan Borjigin-Wang , Irene Madejski , Robert L. Grossman

Multimodal data modeling has emerged as a powerful approach in clinical research, enabling the integration of diverse data types such as imaging, genomics, wearable sensors, and electronic health records. Despite its potential to improve…

Medical text embedding models are foundational to a wide array of healthcare applications, ranging from clinical decision support and biomedical information retrieval to medical question answering, yet they remain hampered by two critical…

Computation and Language · Computer Science 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Hamidreza Mahyar

Physiologically Based Pharmacokinetic (PBPK) modeling is a cornerstone of model-informed drug development (MIDD), providing a mechanistic framework to predict drug absorption, distribution, metabolism, and excretion (ADME). Despite its…

Machine Learning · Computer Science 2026-02-24 Shunqi Liu , Han Qiu , Tong Wang

Medical image analysis using deep learning frameworks has advanced healthcare by automating complex tasks, but many existing frameworks lack flexibility, modularity, and user-friendliness. To address these challenges, we introduce Yucca, an…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Sebastian Nørgaard Llambias , Julia Machnio , Asbjørn Munk , Jakob Ambsdorf , Mads Nielsen , Mostafa Mehdipour Ghazi

In recent years, Multi-modal Foundation Models (MFMs) and Embodied Artificial Intelligence (EAI) have been advancing side by side at an unprecedented pace. The integration of the two has garnered significant attention from the AI research…

Artificial Intelligence · Computer Science 2024-10-08 Min Zhang , Xian Fu , Jianye Hao , Peilong Han , Hao Zhang , Lei Shi , Hongyao Tang , Yan Zheng

Large-scale multi-modal deep learning models have revolutionized domains such as healthcare, highlighting the importance of computational power. However, in resource-constrained regions like Low and Middle-Income Countries (LMICs), limited…

Advances in foundation modeling have reshaped computational pathology. However, the increasing number of available models and lack of standardized benchmarks make it increasingly complex to assess their strengths, limitations, and potential…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Andrew Zhang , Guillaume Jaume , Anurag Vaidya , Tong Ding , Faisal Mahmood

In the field of medical imaging, AI-assisted techniques such as object detection, segmentation, and classification are widely employed to alleviate the workload of physicians and doctors. However, single-task models are predominantly used,…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Fan Li , Arun Iyengar , Lanyu Xu

Cytology is essential for cancer diagnostics and screening due to its minimally invasive nature. However, the development of robust deep learning models for digital cytology is challenging due to the heterogeneity in staining and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Vedrana Ivezić , Ashwath Radhachandran , Ekaterina Redekop , Shreeram Athreya , Dongwoo Lee , Vivek Sant , Corey Arnold , William Speier

Multimodal single-cell technologies enable the simultaneous collection of diverse data types from individual cells, enhancing our understanding of cellular states. However, the integration of these datatypes and modeling the…

Machine Learning · Computer Science 2023-11-22 Bhavya Mehta , Nirmit Deliwala , Madhav Chandane

Multi-disease diagnosis using multi-modal data like electronic health records and medical imaging is a critical clinical task. Although existing deep learning methods have achieved initial success in this area, a significant gap persists…

Multimedia · Computer Science 2025-09-22 Yueheng Jiang , Peng Zhang

Multimodal clinical data are characterized by high dimensionality, heterogeneous representations, and structured missingness, posing significant challenges for predictive modeling, data integration, and interpretability. We propose BIONIC…

Many healthcare applications are inherently multimodal, involving several physiological signals. As sensors for these signals become more common, improving machine learning methods for multimodal healthcare data is crucial. Pretraining…

Machine Learning · Computer Science 2024-10-23 Ching Fang , Christopher Sandino , Behrooz Mahasseni , Juri Minxha , Hadi Pouransari , Erdrin Azemi , Ali Moin , Ellen Zippi

Graph embedding learning that aims to automatically learn low-dimensional node representations, has drawn increasing attention in recent years. To date, most recent graph embedding methods are evaluated on social and information networks…

Despite the wealth of single-cell multi-omics data, it remains challenging to predict the consequences of novel genetic and chemical perturbations in the human body. It requires knowledge of molecular interactions at all biological levels,…

Artificial Intelligence · Computer Science 2025-01-22 You Wu , Lei Xie

Metadata are general characteristics of the data in a well-curated and condensed format, and have been proven to be useful for decision making, knowledge discovery, and also heterogeneous data organization of biobank. Among all data types…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Wei-Hung Weng , Yuannan Cai , Angela Lin , Fraser Tan , Po-Hsuan Cameron Chen

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

The emerging trend of advancing generalist artificial intelligence, such as GPTv4 and Gemini, has reshaped the landscape of research (academia and industry) in machine learning and many other research areas. However, domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Xiaosong Wang , Xiaofan Zhang , Guotai Wang , Junjun He , Zhongyu Li , Wentao Zhu , Yi Guo , Qi Dou , Xiaoxiao Li , Dequan Wang , Liang Hong , Qicheng Lao , Tong Ruan , Yukun Zhou , Yixue Li , Jie Zhao , Kang Li , Xin Sun , Lifeng Zhu , Shaoting Zhang

Understanding the biological mechanisms of disease is crucial for medicine, and in particular, for drug discovery. AI-powered analysis of genome-scale biological data holds great potential in this regard. The increasing availability of…