English
Related papers

Related papers: A Molecular Multimodal Foundation Model Associatin…

200 papers

Despite their ability to understand chemical knowledge, large language models (LLMs) remain limited in their capacity to propose novel molecules with desired functions (e.g., drug-like properties). In addition, the molecules that LLMs…

Molecular property prediction has gained significant attention due to its transformative potential in multiple scientific disciplines. Conventionally, a molecule graph can be represented either as a graph-structured data or a SMILES text.…

Machine Learning · Computer Science 2023-07-17 Chen Qian , Huayi Tang , Zhirui Yang , Hong Liang , Yong Liu

As humans, we experience the world with all our senses or modalities (sound, sight, touch, smell, and taste). We use these modalities, particularly sight and touch, to convey and interpret specific meanings. Multimodal expressions are…

Machine Learning · Computer Science 2022-05-17 Anirudh Sundar , Larry Heck

Multimodal large language models (MLLMs) have made impressive progress in many applications in recent years. However, chemical MLLMs that can handle cross-modal understanding and generation remain underexplored. To fill this gap, we propose…

Machine Learning · Computer Science 2025-08-05 Qian Tan , Dongzhan Zhou , Peng Xia , Wanhao Liu , Wanli Ouyang , Lei Bai , Yuqiang Li , Tianfan Fu

Deep learning is changing many areas in molecular physics, and it has shown great potential to deliver new solutions to challenging molecular modeling problems. Along with this trend arises the increasing demand of expressive and versatile…

Machine Learning · Computer Science 2023-12-27 Jun Zhang , Yao-Kun Lei , Yaqiang Zhou , Yi Isaac Yang , Yi Qin Gao

AI models for drug discovery and chemical literature mining must interpret molecular images and generate outputs consistent with 3D geometry and stereochemistry. Most molecular language models rely on strings or graphs, while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Jing Lan , Hexiao Ding , Hongzhao Chen , Yufeng Jiang , Nga-Chun Ng , Gwing Kei Yip , Gerald W. Y. Cheng , Yunlin Mao , Jing Cai , Liang-ting Lin , Jung Sun Yoo

Current molecular understanding approaches predominantly focus on the descriptive aspect of human perception, providing broad, topic-level insights. However, the referential aspect -- linking molecular concepts to specific structural…

Artificial Intelligence · Computer Science 2025-05-02 Jiaxin Wu , Ting Zhang , Rubing Chen , Wengyu Zhang , Chen Jason Zhang , Xiao-Yong Wei , Li Qing

Coarse graining enables the investigation of molecular dynamics for larger systems and at longer timescales than is possible at atomic resolution. However, a coarse graining model must be formulated such that the conclusions we draw from it…

A molecule's geometry, also known as conformation, is one of a molecule's most important properties, determining the reactions it participates in, the bonds it forms, and the interactions it has with other molecules. Conventional…

Machine Learning · Computer Science 2020-01-01 Elman Mansimov , Omar Mahmood , Seokho Kang , Kyunghyun Cho

Large-scale "pre-train and prompt learning" paradigms have demonstrated remarkable adaptability, enabling broad applications across diverse domains such as question answering, image recognition, and multimodal retrieval. This approach fully…

The foundation model has heralded a new era in artificial intelligence, pretraining a single model to offer cross-domain transferability on different datasets. Graph neural networks excel at learning graph data, the omnipresent…

Machine Learning · Computer Science 2025-04-09 Li Sun , Zhenhao Huang , Suyang Zhou , Qiqi Wan , Hao Peng , Philip Yu

This review explores the potential of foundation models to advance laboratory automation in the materials and chemical sciences. It emphasizes the dual roles of these models: cognitive functions for experimental planning and data analysis,…

Knowledge graph reasoning is pivotal in various domains such as data mining, artificial intelligence, the Web, and social sciences. These knowledge graphs function as comprehensive repositories of human knowledge, facilitating the inference…

Artificial Intelligence · Computer Science 2024-12-17 Lihui Liu , Zihao Wang , Hanghang Tong

Healthcare and medicine are multimodal disciplines that deal with multimodal data for reasoning and diagnosing multiple diseases. Although some multimodal reasoning models have emerged for reasoning complex tasks in scientific domains,…

Artificial Intelligence · Computer Science 2025-09-16 Susanta Mitra

The rapid evolution of artificial intelligence in drug discovery encounters challenges with generalization and extensive training, yet Large Language Models (LLMs) offer promise in reshaping interactions with complex molecular data. Our…

Biomolecules · Quantitative Biology 2024-12-20 He Cao , Zijing Liu , Xingyu Lu , Yuan Yao , Yu Li

Accurate extraction of molecular representations is a critical step in the drug discovery process. In recent years, significant progress has been made in molecular representation learning methods, among which multi-modal molecular…

Machine Learning · Computer Science 2025-05-13 Rong Yin , Ruyue Liu , Xiaoshuai Hao , Xingrui Zhou , Yong Liu , Can Ma , Weiping Wang

Generative artificial intelligence (AI) systems based on large-scale pretrained foundation models (PFMs) such as vision-language models, large language models (LLMs), diffusion models and vision-language-action (VLA) models have…

Artificial Intelligence · Computer Science 2025-01-07 Alhassan Mumuni , Fuseini Mumuni

Deep learning methods have revolutionized speech recognition, image recognition, and natural language processing since 2010. Each of these tasks involves a single modality in their input signals. However, many applications in the artificial…

Artificial Intelligence · Computer Science 2020-07-15 Chao Zhang , Zichao Yang , Xiaodong He , Li Deng

The success of language models, especially transformer-based architectures, has trickled into other domains giving rise to "scientific language models" that operate on small molecules, proteins or polymers. In chemistry, language models…

Chemical Physics · Physics 2024-10-22 Nikita Janakarajan , Tim Erdmann , Sarath Swaminathan , Teodoro Laino , Jannis Born

Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Khiem Le , Zhichun Guo , Kaiwen Dong , Xiaobao Huang , Bozhao Nan , Roshni Iyer , Xiangliang Zhang , Olaf Wiest , Wei Wang , Ting Hua , Nitesh V. Chawla
‹ Prev 1 4 5 6 7 8 10 Next ›