English
Related papers

Related papers: ChemDFM-X: Towards Large Multimodal Model for Chem…

200 papers

The advent of Large Language Models (LLMs) has paved the way for AI search engines, e.g., SearchGPT, showcasing a new paradigm in human-internet interaction. However, most current AI search engines are limited to text-only settings,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Dongzhi Jiang , Renrui Zhang , Ziyu Guo , Yanmin Wu , Jiayi Lei , Pengshuo Qiu , Pan Lu , Zehui Chen , Chaoyou Fu , Guanglu Song , Peng Gao , Yu Liu , Chunyuan Li , Hongsheng Li

Multimodal learning, a rapidly evolving field in artificial intelligence, seeks to construct more versatile and robust systems by integrating and analyzing diverse types of data, including text, images, audio, and video. Inspired by the…

Artificial Intelligence · Computer Science 2024-12-24 Priyaranjan Pattnayak , Hitesh Laxmichand Patel , Bhargava Kumar , Amit Agarwal , Ishan Banerjee , Srikant Panda , Tejaswini Kumar

The discovery of new catalysts is essential for the design of new and more efficient chemical processes in order to transition to a sustainable future. We introduce an AI-guided computational screening framework unifying linguistic…

Artificial intelligence has demonstrated immense potential in scientific research. Within molecular science, it is revolutionizing the traditional computer-aided paradigm, ushering in a new era of deep learning. With recent progress in…

Biomolecules · Quantitative Biology 2024-03-22 Yi Xiao , Xiangxin Zhou , Qiang Liu , Liang Wang

Molecular optimization is a crucial yet complex and time-intensive process that often acts as a bottleneck for drug development. Traditional methods rely heavily on trial and error, making multi-objective optimization both time-consuming…

Biomolecules · Quantitative Biology 2025-03-06 Jiajun Yu , Yizhen Zheng , Huan Yee Koh , Shirui Pan , Tianyue Wang , Haishuai Wang

Recent vision-language models (VLMs) have shown strong generalization and multimodal reasoning abilities in natural domains. However, their application to medical diagnosis remains limited by the lack of comprehensive and structured…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Sheng Lu , Hao Chen , Rui Yin , Juyan Ba , Yu Zhang , Yuanzhe Li

The prediction of chemical synthesis pathways plays a pivotal role in materials science research. Challenges, such as the complexity of synthesis pathways and the lack of comprehensive datasets, currently hinder our ability to predict these…

Materials Science · Physics 2023-11-03 Ziyi Chen , Fankai Xie , Meng Wan , Yang Yuan , Miao Liu , Zongguo Wang , Sheng Meng , Yangang Wang

This paper introduces M$^{3}$-20M, a large-scale Multi-Modal Molecule dataset that contains over 20 million molecules, with the data mainly being integrated from existing databases and partially generated by large language models. Designed…

Quantitative Methods · Quantitative Biology 2025-03-18 Siyuan Guo , Lexuan Wang , Chang Jin , Jinxian Wang , Han Peng , Huayang Shi , Wengen Li , Jihong Guan , Shuigeng Zhou

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Davide Caffagni , Federico Cocchi , Luca Barsellotti , Nicholas Moratelli , Sara Sarto , Lorenzo Baraldi , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

Large language models (LLMs) have large potential for molecular optimization, as they can gather external chemistry tools and enable collaborative interactions to iteratively refine molecular candidates. However, this potential remains…

Artificial Intelligence · Computer Science 2025-05-28 Hyomin Kim , Yunhui Jang , Sungsoo Ahn

The drug development process necessitates that pharmacologists undertake various tasks, such as reviewing literature, formulating hypotheses, designing experiments, and interpreting results. Each stage requires accessing and querying vast…

Computation and Language · Computer Science 2023-08-01 Hong Lu , Chuan Li , Yinheng Li , Jie Zhao

Natural language is expected to be a key medium for various human-machine interactions in the era of large language models. When it comes to the biochemistry field, a series of tasks around molecules (e.g., property prediction, molecule…

Computation and Language · Computer Science 2023-06-22 Zheni Zeng , Bangchen Yin , Shipeng Wang , Jiarui Liu , Cheng Yang , Haishen Yao , Xingzhi Sun , Maosong Sun , Guotong Xie , Zhiyuan Liu

Mathematical reasoning, a core aspect of human cognition, is vital across many domains, from educational problem-solving to scientific advancements. As artificial general intelligence (AGI) progresses, integrating large language models…

Computation and Language · Computer Science 2025-05-21 Yibo Yan , Jiamin Su , Jianxiang He , Fangteng Fu , Xu Zheng , Yuanhuiyi Lyu , Kun Wang , Shen Wang , Qingsong Wen , Xuming Hu

While Vision-Language Models (VLMs) have demonstrated significant potential in chemical visual understanding, current models are predominantly optimized for direct visual question-answering tasks. This paradigm often results in "black-box"…

Computation and Language · Computer Science 2026-04-09 Xuanle Zhao , Xinyuan Cai , Xiang Cheng , Xiuyi Chen , Bo Xu

Next-generation multimodal foundation models capable of any-to-any cross-modal generation and multi-turn interaction will serve as core components of artificial general intelligence systems, playing a pivotal role in human-machine…

Computation and Language · Computer Science 2025-10-17 Run Luo , Xiaobo Xia , Lu Wang , Longze Chen , Renke Shan , Jing Luo , Min Yang , Tat-Seng Chua

Modern medical records include a vast amount of multimodal free text clinical data and imaging data from radiology, cardiology, and digital pathology. Fully mining such big data requires multitasking; otherwise, occult but important aspects…

Image and Video Processing · Electrical Eng. & Systems 2024-04-25 Chuang Niu , Qing Lyu , Christopher D. Carothers , Parisa Kaviani , Josh Tan , Pingkun Yan , Mannudeep K. Kalra , Christopher T. Whitlow , Ge Wang

Large Language Models (LLMs) stand at the forefront of a number of Natural Language Processing (NLP) tasks. Despite the widespread adoption of LLMs in NLP, much of their potential in broader fields remains largely unexplored, and…

Machine Learning · Computer Science 2024-03-11 Zhiqiang Zhong , Kuangyu Zhou , Davide Mottin

In this work, we introduce ChemBFN, a language model that handles chemistry tasks based on Bayesian flow networks working on discrete data. A new accuracy schedule is proposed to improve the sampling quality by significantly reducing the…

Machine Learning · Computer Science 2025-01-31 Nianze Tao , Minori Abe

Large Language Models (LLMs) have emerged as a transformative power in enhancing natural language comprehension, representing a significant stride toward artificial general intelligence. The application of LLMs extends beyond conventional…