English
Related papers

Related papers: Chem4DLLM: 4D Multimodal LLMs for Chemical Dynamic…

200 papers

Although large language models (LLMs) have significant potential to advance chemical discovery, current LLMs lack core chemical knowledge, produce unreliable reasoning trajectories, and exhibit suboptimal performance across diverse chemical…

Computational Engineering, Finance, and Science · Computer Science 2025-10-23 Weida Wang , Benteng Chen , Di Zhang , Wanhao Liu , Shuchen Pu , Ben Gao , Jin Zeng , Xiaoyong Wei , Tianshu Yu , Shuzhou Sun , Tianfan Fu , Wanli Ouyang , Lei Bai , Jiatong Li , Zifu Wang , Yuqiang Li , Shufei Zhang

Predicting and enhancing inherent properties based on molecular structures is paramount to design tasks in medicine, materials science, and environmental management. Most of the current machine learning and deep learning approaches have…

Machine Learning · Computer Science 2024-04-08 Zachary R. Fox , Ayana Ghosh

How to effectively represent molecules is a long-standing challenge for molecular property prediction and drug discovery. This paper studies this problem and proposes to incorporate chemical domain knowledge, specifically related to…

Machine Learning · Computer Science 2023-05-04 Liang Zeng , Lanqing Li , Jian Li

Applications of machine learning in chemistry are often limited by the scarcity and expense of labeled data, restricting traditional supervised methods. In this work, we introduce a framework for molecular reasoning using general-purpose…

Multilingual capability is an essential aspect for large multimodal models, since they are usually deployed across various countries and languages. However, most existing benchmarks for multilingual multimodal reasoning struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Hongyu Wang , Jiayu Xu , Senwei Xie , Ruiping Wang , Jialin Li , Zhaojie Xie , Bin Zhang , Chuyan Xiong , Xilin Chen

While showing impressive performance on various kinds of learning tasks, it is yet unclear whether deep learning models have the ability to robustly tackle reasoning tasks. than by learning the underlying reasoning process that is actually…

Machine Learning · Computer Science 2022-10-06 Andrea Valenti , Davide Bacciu , Antonio Vergari

Large Language Models (LLMs) stand at the forefront of a number of Natural Language Processing (NLP) tasks. Despite the widespread adoption of LLMs in NLP, much of their potential in broader fields remains largely unexplored, and…

Machine Learning · Computer Science 2024-03-11 Zhiqiang Zhong , Kuangyu Zhou , Davide Mottin

Human expertise in chemistry and biomedicine relies on contextual molecular understanding, a capability that large language models (LLMs) can extend through fine-grained alignment between molecular structures and text. Recent multimodal…

Computation and Language · Computer Science 2025-03-10 Sumin Ha , Jun Hyeong Kim , Yinhua Piao , Sun Kim

Recent large multimodal models (LMMs) have become increasingly capable on image and video understanding, yet still struggle to sustain 4D continuous spatiotemporal dynamic reasoning. To study this capability gap, we formulate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Chaoyue Li , Yongxue Xu , Jie Feng , Jiayu Ding

Multimodal scientific reasoning remains a significant challenge for large language models (LLMs), particularly in chemistry, where problem-solving relies on symbolic diagrams, molecular structures, and structured visual data. Here, we…

Computation and Language · Computer Science 2025-12-18 Yiming Cui , Xin Yao , Yuxuan Qin , Xin Li , Shijin Wang , Guoping Hu

We present a perspective on molecular machine learning (ML) in the field of chemical process engineering. Recently, molecular ML has demonstrated great potential in (i) providing highly accurate predictions for properties of pure components…

Chemical Physics · Physics 2025-09-01 Jan G. Rittig , Manuel Dahmen , Martin Grohe , Philippe Schwaller , Alexander Mitsos

Recent advancements in large language models (LLMs) have demonstrated strong potential for enabling domain-specific intelligence. In this work, we present our vision for building an AI-powered chemical brain, which frames chemical…

Artificial Intelligence · Computer Science 2026-01-12 Weichen Dai , Yezeng Chen , Zijie Dai , Yubo Liu , Zhijie Huang , Yixuan Pan , Baiyang Song , Chengli Zhong , Xinhe Li , Zeyu Wang , Zhuoying Feng , Yi Zhou

The discovery of new catalysts is essential for the design of new and more efficient chemical processes in order to transition to a sustainable future. We introduce an AI-guided computational screening framework unifying linguistic…

Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language, symbolic notations, with emerging extensions to incorporate multi-modal…

Machine Learning · Computer Science 2025-05-23 Ziqing Wang , Kexin Zhang , Zihan Zhao , Yibo Wen , Abhishek Pandey , Han Liu , Kaize Ding

Vision language models (VLMs) have shown remarkable capabilities in integrating linguistic and visual reasoning but remain fundamentally limited in understanding dynamic spatiotemporal interactions. Humans effortlessly track and reason…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Shijie Zhou , Alexander Vilesov , Xuehai He , Ziyu Wan , Shuwang Zhang , Aditya Nagachandra , Di Chang , Dongdong Chen , Xin Eric Wang , Achuta Kadambi

Molecular representation learning is pivotal in predicting molecular properties and advancing drug design. Traditional methodologies, which predominantly rely on homogeneous graph encoding, are limited by their inability to integrate…

Machine Learning · Computer Science 2025-03-24 Mukun Chen , Jia Wu , Shirui Pan , Fu Lin , Bo Du , Xiuwen Gong , Wenbin Hu

Chemistry plays a crucial role in many domains, such as drug discovery and material science. While large language models (LLMs) such as GPT-4 exhibit remarkable capabilities on natural language processing tasks, existing research indicates…

Artificial Intelligence · Computer Science 2024-08-13 Botao Yu , Frazier N. Baker , Ziqi Chen , Xia Ning , Huan Sun

The integration of molecular and natural language representations has emerged as a focal point in molecular science, with recent advancements in Language Models (LMs) demonstrating significant potential for comprehensive modeling of both…

Biomolecules · Quantitative Biology 2025-03-19 Qizhi Pei , Rui Yan , Kaiyuan Gao , Jinhua Zhu , Lijun Wu

A 3D scene graph represents a compact scene model by capturing both the objects present and the semantic relationships between them, making it a promising structure for robotic applications. To effectively interact with users, an embodied…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Tatiana Zemskova , Dmitry Yudin

Proteins are essential macromolecules defined by their amino acid sequences, which determine their three-dimensional structures and, consequently, their functions in all living organisms. Therefore, generative protein modeling necessitates…

Machine Learning · Computer Science 2024-10-18 Xinyou Wang , Zaixiang Zheng , Fei Ye , Dongyu Xue , Shujian Huang , Quanquan Gu