English
Related papers

Related papers: Multimodal Learning for Embryo Viability Predictio…

200 papers

Artificial intelligence has recently shown promise in automated embryo selection for In-Vitro Fertilization (IVF). However, current approaches either address partial embryo evaluation lacking holistic quality assessment or target clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yong Sun , Yipeng Wang , Junyu Shi , Zhiyuan Zhang , Yanmei Xiao , Lei Zhu , Manxi Jiang , Qiang Nie

Recent deep learning research based on Transformer model architectures has demonstrated state-of-the-art performance across a variety of domains and tasks, mostly within the computer vision and natural language processing domains. While…

Machine Learning · Computer Science 2021-11-11 Benjamin Shickel , Patrick J. Tighe , Azra Bihorac , Parisa Rashidi

An important limitation to the development of Artificial Intelligence (AI)-based solutions for In Vitro Fertilization (IVF) is the absence of a public reference benchmark to train and evaluate deep learning (DL) models. In this work, we…

Image and Video Processing · Electrical Eng. & Systems 2022-05-16 Tristan Gomez , Magalie Feyeux , Nicolas Normand , Laurent David , Perrine Paul-Gilloteaux , Thomas Fréour , Harold Mouchère

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

Left ventricular ejection fraction (LVEF) assessment depends on echocardiography, limiting access in primary care and resource-constrained settings. We developed a multimodal machine-learning framework that combines engineered 12-lead ECG…

Machine Learning · Computer Science 2026-04-30 Catherine Ning , Yu Ma , Cindy Beini Wang , Sean McMahon , Joseph Radojevic , Steven Zweibel , Dimitris Bertsimas

Assessing and selecting the most viable embryos for transfer is an essential part of in vitro fertilization (IVF). In recent years, several approaches have been made to improve and automate the procedure using artificial intelligence (AI)…

Machine Learning · Computer Science 2022-04-06 Jørgen Berntsen , Jens Rimestad , Jacob Theilgaard Lassen , Dang Tran , Mikkel Fly Kragh

Deep-learning-based clinical decision support using structured electronic health records (EHR) has been an active research area for predicting risks of mortality and diseases. Meanwhile, large amounts of narrative clinical notes provide…

Computation and Language · Computer Science 2023-05-10 Weimin Lyu , Xinyu Dong , Rachel Wong , Songzhu Zheng , Kayley Abell-Hart , Fusheng Wang , Chao Chen

Accurate localization and segmentation of intervertebral disc (IVD) is crucial for the assessment of spine disease diagnosis. Despite the technological advances in medical imaging, IVD localization and segmentation are still manually…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Jose Dolz , Christian Desrosiers , Ismail Ben Ayed

Health conditions among patients in intensive care units (ICUs) are monitored via electronic health records (EHRs), composed of numerical time series and lengthy clinical note sequences, both taken at irregular time intervals. Dealing with…

Machine Learning · Computer Science 2023-06-07 Xinlu Zhang , Shiyang Li , Zhiyu Chen , Xifeng Yan , Linda Petzold

The developmental process of embryos follows a monotonic order. An embryo can progressively cleave from one cell to multiple cells and finally transform to morula and blastocyst. For time-lapse videos of embryos, most existing developmental…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Stanislav Lukyanenko , Won-Dong Jang , Donglai Wei , Robbert Struyven , Yoon Kim , Brian Leahy , Helen Yang , Alexander Rush , Dalit Ben-Yosef , Daniel Needleman , Hanspeter Pfister

Machine learning holds promise for advancing clinical decision support, yet it remains unclear when multimodal learning truly helps in practice, particularly under modality missingness and fairness constraints. In this work, we conduct a…

Machine Learning · Computer Science 2026-03-02 Kejing Yin , Haizhou Xu , Wenfang Yao , Chen Liu , Zijie Chen , Yui Haang Cheung , William K. Cheung , Jing Qin

Early prediction of mortality and length of stay(LOS) of a patient is vital for saving a patient's life and management of hospital resources. Availability of electronic health records(EHR) makes a huge impact on the healthcare domain and…

Machine Learning · Computer Science 2020-12-01 Batuhan Bardak , Mehmet Tan

Multimodality Representation Learning, as a technique of learning to embed information from different modalities and their correlations, has achieved remarkable success on a variety of applications, such as Visual Question Answering (VQA),…

Artificial Intelligence · Computer Science 2024-03-04 Muhammad Arslan Manzoor , Sarah Albarri , Ziting Xian , Zaiqiao Meng , Preslav Nakov , Shangsong Liang

Infertility is a major global health issue, and while in-vitro fertilization has improved treatment outcomes, embryo selection remains a critical bottleneck. Time-lapse imaging enables continuous, non-invasive monitoring of embryo…

Recent advancements in multimodal foundation models have showcased impressive capabilities in understanding and reasoning with visual and textual information. Adapting these foundation models trained for general usage to specialized domains…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Hejie Cui , Lingjun Mao , Xin Liang , Jieyu Zhang , Hui Ren , Quanzheng Li , Xiang Li , Carl Yang

Predicting in-hospital mortality for intensive care unit (ICU) patients is key to final clinical outcomes. AI has shown advantaged accuracy but suffers from the lack of explainability. To address this issue, this paper proposes an…

Machine Learning · Computer Science 2024-01-01 Xingqiao Li , Jindong Gu , Zhiyong Wang , Yancheng Yuan , Bo Du , Fengxiang He

Multimodal clinical prediction is widely used to integrate heterogeneous data such as Electronic Health Records (EHR) and biosignals. However, existing methods tend to rely on static modality integration schemes and simple fusion…

Machine Learning · Computer Science 2026-01-16 Jongseok Kim , Seongae Kang , Jonghwan Shin , Yuhan Lee , Ohyun Jo

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

The early detection of a pulmonary embolism (PE) is critical for enhancing patient survival rates. Both image-based and non-image-based features are of utmost importance in medical classification tasks. In a clinical setting, physicians…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Zhaoxin Guo , Zhipeng Wang , Ruiquan Ge , Jianxun Yu , Feiwei Qin , Yuan Tian , Yuqing Peng , Yonghong Li , Changmiao Wang

Macroscopic, phenomenological models have proven useful as concise framings of our understandings in fields from statistical physics to economics to biology. Constructing a phenomenological model for development would provide a framework…

Cell Behavior · Quantitative Biology 2021-03-24 Brian D Leahy , Catherine Racowsky , Daniel Needleman