English
Related papers

Related papers: HoneyBee: A Scalable Modular Framework for Creatin…

200 papers

Clinical decision-making in oncology involves multimodal data such as radiology scans, molecular profiling, histopathology slides, and clinical factors. Despite the importance of these modalities individually, no deep learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Nathaniel Braman , Jacob W. H. Gordon , Emery T. Goossens , Caleb Willis , Martin C. Stumpe , Jagadish Venkataraman

The integration of Artificial Intelligence (AI) into pathology faces a fundamental challenge: black-box predictive models lack transparency, while generative approaches risk clinical hallucination. A case-based retrieval paradigm offers a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Qifeng Zhou , Wenliang Zhong , Thao M. Dang , Hehuan Ma , Saiyang Na , Yuzhi Guo , Junzhou Huang

Healthcare models are transitioning from unimodal prediction toward multimodal reasoning over heterogeneous diagnostic inputs. In computational pathology, for complex tumor subtypes where morphology alone can be challenging to distinguish,…

The advent of foundation models has heralded a new era in medical artificial intelligence (AI), enabling the extraction of generalizable representations from large-scale unlabeled datasets. However, current ophthalmic AI paradigms are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Tienyu Chang , Zhen Chen , Renjie Liang , Jinyu Ding , Jie Xu , Sunu Mathew , Amir Reza Hajrasouliha , Andrew J. Saykin , Ruogu Fang , Yu Huang , Jiang Bian , Qingyu Chen

Each year, the lack of efficient data standardization and interoperability in cancer care contributes to the severe lack of timely and effective diagnosis, while constantly adding to the burden of cost, with cancer costs nationally reaching…

Machine Learning · Computer Science 2024-10-29 Aarsh Shekhar , Mincheol Kim

Shared embedding spaces are widely used for multimodal search and data curation. In practice, two problems often limit how well this works. First, embeddings can reflect modality more than meaning, so examples cluster by input type even…

Information Retrieval · Computer Science 2026-05-05 Pratyush Muthukumar , Harshil Kotamreddy , Sarah Amiraslani , Tomo Kanazawa , Ramani Akkati , Shaan Jain , Andrew Mathau

Oral cancer is frequently diagnosed at later stages due to its similarity to other lesions. Existing research on computer aided diagnosis has made progress using deep learning; however, most approaches remain limited by small, imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Joy Naoum , Revana Salama , Ali Hamdi

Accurate and reliable histopathological image classification is essential for breast cancer diagnosis. However, many deep learning models remain sensitive to magnification variability and lack interpretability. To address these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Enam Ahmed Taufika , Md Ahasanul Arafatha , Abhijit Kumar Ghoshb , Md. Tanzim Rezab , Md Ashad Alamc

Accurate segmentation and classification of nuclei in histology images is critical but challenging due to nuclei heterogeneity, staining variations, and tissue complexity. Existing methods often struggle with limited dataset variability,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Wenhua Zhang , Sen Yang , Meiwei Luo , Chuan He , Yuchen Li , Jun Zhang , Xiyue Wang , Fang Wang

We propose a deep mixture of multimodal hierarchical variational auto-encoders called MMHVAE that synthesizes missing images from observed images in different modalities. MMHVAE's design focuses on tackling four challenges: (i) creating a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Reuben Dorent , Nazim Haouchine , Alexandra Golby , Sarah Frisken , Tina Kapur , William Wells

Automated semantic segmentation of whole-slide images (WSIs) stained with hematoxylin and eosin (H&E) is essential for large-scale artificial intelligence-based biomarker analysis in breast cancer. However, existing public datasets for…

With the advancement of high-throughput biotechnologies, we increasingly accumulate biomedical data about diseases, especially cancer. There is a need for computational models and methods to sift through, integrate, and extract new…

Quantitative Methods · Quantitative Biology 2020-07-03 Thomas Gaudelet , Noel Malod-Dognin , Natasa Przulj

Biomedical text embeddings have primarily been developed using research literature from PubMed, yet clinical cardiology practice relies heavily on procedural knowledge and specialized terminology found in comprehensive textbooks rather than…

Computation and Language · Computer Science 2025-11-17 Richard J. Young , Alice M. Matthews

In healthcare, multimodal data is prevalent and requires to be comprehensively analyzed before diagnostic decisions, including medical images, clinical reports, etc. However, current large-scale artificial intelligence models predominantly…

Artificial Intelligence · Computer Science 2023-06-29 Weihua Liu , Yong Zuo

The essence of precision oncology lies in its commitment to tailor targeted treatments and care measures to each patient based on the individual characteristics of the tumor. The inherent heterogeneity of tumors necessitates gathering…

Quantitative Methods · Quantitative Biology 2024-07-01 Huajun Zhou , Fengtao Zhou , Chenyu Zhao , Yingxue Xu , Luyang Luo , Hao Chen

Accurate classification of pediatric central nervous system tumors remains challenging due to histological complexity and limited training data. While pathology foundation models have advanced whole-slide image (WSI) analysis, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jian Yu , Joakim Nguyen , Jinrui Fang , Awais Naeem , Zeyuan Cao , Sanjay Krishnan , Nicholas Konz , Tianlong Chen , Chandra Krishnan , Hairong Wang , Edward Castillo , Ying Ding , Ankita Shukla

Multi-omics research has enhanced our understanding of cancer heterogeneity and progression. Investigating molecular data through multi-omics approaches is crucial for unraveling the complex biological mechanisms underlying cancer, thereby…

Envelope model also known as multivariate regression model was proposed to solve the multiple response regression problems. It measures the linear association between predictors and multiple responses by using the minimal reducing subspace…

Methodology · Statistics 2018-05-07 Bochao Jia

Medical text embedding models are foundational to a wide array of healthcare applications, ranging from clinical decision support and biomedical information retrieval to medical question answering, yet they remain hampered by two critical…

Computation and Language · Computer Science 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Hamidreza Mahyar