English
Related papers

Related papers: Learning Cell-Aware Hierarchical Multi-Modal Repre…

200 papers

Molecular Relational Learning (MRL) aims to understand interactions between molecular pairs, playing a critical role in advancing biochemical research. With the recent development of large language models (LLMs), a growing number of studies…

Machine Learning · Computer Science 2025-06-03 Zhuo Chen , Yizhen Zheng , Huan Yee Koh , Hongxin Xiang , Linjiang Chen , Wenjie Du , Yang Wang

Molecule representation learning (MRL) methods aim to embed molecules into a real vector space. However, existing SMILES-based (Simplified Molecular-Input Line-Entry System) or GNN-based (Graph Neural Networks) MRL methods either take…

Machine Learning · Computer Science 2021-09-23 Hongwei Wang , Weijiang Li , Xiaomeng Jin , Kyunghyun Cho , Heng Ji , Jiawei Han , Martin D. Burke

A high-performing, general-purpose visual understanding model should map visual inputs to a taxonomic tree of labels, identify novel categories beyond the training set for which few or no publicly available images exist. Large Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Hulingxiao He , Zhi Tan , Yuxin Peng

Chemical representation learning has gained increasing interest due to the limited availability of supervised data in fields such as drug and materials design. This interest particularly extends to chemical language representation learning,…

Chemical Physics · Physics 2024-08-06 Jun-Hyung Park , Yeachan Kim , Mingyu Lee , Hyuntae Park , SangKeun Lee

Multimodal learning that integrates histopathology images and genomic data holds great promise for cancer survival prediction. However, existing methods face key limitations: 1) They rely on multimodal mapping and metrics in Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Jiaqi Yang , Wenting Chen , Xiaohan Xing , Sean He , Xiaoling Luo , Xinheng Lyu , Linlin Shen , Guoping Qiu

Cognitive Diagnosis Models (CDMs) are a special family of discrete latent variable models that are widely used in modern educational, psychological, social and biological sciences. A key component of CDMs is a binary $Q$-matrix…

Methodology · Statistics 2025-01-08 Chenchen Ma , Gongjun Xu

With the widespread application of multimodal large language models in scientific intelligence, there is an urgent need for more challenging evaluation benchmarks to assess their ability to understand complex scientific data. Scientific…

Artificial Intelligence · Computer Science 2025-12-12 Yitong Zhou , Mingyue Cheng , Qingyang Mao , Yucong Luo , Qi Liu , Yupeng Li , Xiaohan Zhang , Deguang Liu , Xin Li , Enhong Chen

Clinical machine learning models are increasingly trained using large scale, multimodal foundation paradigms, yet deployment environments often differ systematically from the data generating settings used during training. Such shifts arise…

Machine Learning · Computer Science 2026-03-10 Yuanyun Zhang , Shi Li

Artificial intelligence (AI) is reshaping computational and network biology by enabling new approaches to decode cellular communication networks. We introduce Hierarchical Molecular Language Models (HMLMs), a novel framework that models…

Molecular Networks · Quantitative Biology 2025-12-16 Hasi Hays , Yue Yu , William J. Richardson

Accurate prediction of the physicochemical properties of molecular mixtures using graph neural networks remains a significant challenge, as it requires simultaneous embedding of intramolecular interactions while accounting for mixture…

Chemical Physics · Physics 2026-03-04 Jinming Fan , Chao Qian , Wilhelm T. S. Huck , William E. Robinson , Shaodong Zhou

Concept-Based Models (CBMs) are a class of deep learning models that provide interpretability by explaining predictions through high-level concepts. These models first predict concepts and then use them to perform a downstream task.…

Machine Learning · Computer Science 2025-06-27 David Debot , Pietro Barbiero , Gabriele Dominici , Giuseppe Marra

Combinatorial medication recommendation(CMR) is a fundamental task of healthcare, which offers opportunities for clinical physicians to provide more precise prescriptions for patients with intricate health conditions, particularly in the…

Artificial Intelligence · Computer Science 2025-01-14 Jie Tan , Yu Rong , Kangfei Zhao , Tian Bian , Tingyang Xu , Junzhou Huang , Hong Cheng , Helen Meng

Identifying relationships between molecular variations and their clinical presentations has been challenged by the heterogeneous causes of a disease. It is imperative to unveil the relationship between the high dimensional molecular…

Methodology · Statistics 2021-09-02 Wennan Chang , Changlin Wan , Yong Zang , Chi Zhang , Sha Cao

Recent advances in vision-language models have significantly expanded the frontiers of automated image analysis. However, applying these models in safety-critical contexts remains challenging due to the complex relationships between…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Muhammad Imran , Yugyung Lee

The study of cells and their responses to genetic or chemical perturbations promises to accelerate the discovery of therapeutic targets. However, designing adequate and insightful models for such data is difficult because the response of a…

Machine Learning · Computer Science 2024-12-04 Haiyi Mao , Romain Lopez , Kai Liu , Jan-Christian Hütter , David Richmond , Panayiotis V. Benos , Lin Qiu

Molecular Representation Learning (MRL) has emerged as a powerful tool for drug and materials discovery in a variety of tasks such as virtual screening and inverse design. While there has been a surge of interest in advancing model-centric…

Chemical Physics · Physics 2023-09-29 Dingshuo Chen , Yanqiao Zhu , Jieyu Zhang , Yuanqi Du , Zhixun Li , Qiang Liu , Shu Wu , Liang Wang

Graph based molecular representation learning is essential for accurately predicting molecular properties in drug discovery and materials science; however, it faces significant challenges due to the intricate relationships among molecules…

Computational Engineering, Finance, and Science · Computer Science 2025-05-28 Zhengyang Zhou , Yunrui Li , Pengyu Hong , Hao Xu

Continual learning is essential for adapting models to new tasks while retaining previously acquired knowledge. While existing approaches predominantly focus on uni-modal data, multi-modal learning offers substantial benefits by utilizing…

Machine Learning · Computer Science 2025-11-11 Evelyn Chee , Wynne Hsu , Mong Li Lee

Representation learning on large-scale unstructured volumetric and surface meshes poses significant challenges in neuroimaging, especially when models must incorporate diverse vertex-level morphometric descriptors, such as cortical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yujian Xiong , Mohammad Farazi , Yanxi Chen , Wenhui Zhu , Xuanzhao Dong , Natasha Lepore , Yi Su , Raza Mushtaq , Stephen Foldes , Andrew Yang , Yalin Wang

Analyzing and inspecting bone marrow cell cytomorphology is a critical but highly complex and time-consuming component of hematopathology diagnosis. Recent advancements in artificial intelligence have paved the way for the application of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Shayan Fazeli , Alireza Samiei , Thomas D. Lee , Majid Sarrafzadeh