English
Related papers

Related papers: Multi-modal Molecule Structure-text Model for Text…

200 papers

Large Language Models (LLMs) have achieved remarkable success and have been applied across various scientific fields, including chemistry. However, many chemical tasks require the processing of visual information, which cannot be…

Current protein language models (PLMs) learn protein representations mainly based on their sequences, thereby well capturing co-evolutionary information, but they are unable to explicitly acquire protein functions, which is the end goal of…

Biomolecules · Quantitative Biology 2023-07-06 Minghao Xu , Xinyu Yuan , Santiago Miret , Jian Tang

Large Language Models (LLMs) have made great strides in areas such as language processing and computer vision. Despite the emergence of diverse techniques to improve few-shot learning capacity, current LLMs fall short in handling the…

Biomolecules · Quantitative Biology 2024-05-14 Xianggen Liu , Yan Guo , Haoran Li , Jin Liu , Shudong Huang , Bowen Ke , Jiancheng Lv

Models that accurately predict properties based on chemical structure are valuable tools in drug discovery. However, for many properties, public and private training sets are typically small, and it is difficult for the models to generalize…

Quantitative Methods · Quantitative Biology 2022-11-08 Oscar Méndez-Lucio , Christos Nicolaou , Berton Earnshaw

Although artificial intelligence (AI) has made significant progress in understanding molecules in a wide range of fields, existing models generally acquire the single cognitive ability from the single molecular modality. Since the hierarchy…

Machine Learning · Computer Science 2022-09-14 Bing Su , Dazhao Du , Zhao Yang , Yujie Zhou , Jiangmeng Li , Anyi Rao , Hao Sun , Zhiwu Lu , Ji-Rong Wen

Chemical structure extraction from documents remains a hard problem due to both false positive identification of structures during segmentation and errors in the predicted structures. Current approaches rely on handcrafted rules and…

Machine Learning · Computer Science 2018-02-15 Joshua Staker , Kyle Marshall , Robert Abel , Carolyn McQuaw

Pretraining molecular representations is crucial for drug and material discovery. Recent methods focus on learning representations from geometric structures, effectively capturing 3D position information. Yet, they overlook the rich…

Machine Learning · Computer Science 2024-11-19 Teng Xiao , Chao Cui , Huaisheng Zhu , Vasant G. Honavar

Molecular property prediction is a fundamental task in computational chemistry with critical applications in drug discovery and materials science. While recent works have explored Large Language Models (LLMs) for this task, they primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Deepan Adak , Yogesh Singh Rawat , Shruti Vyas

Molecule design is a fundamental problem in molecular science and has critical applications in a variety of areas, such as drug discovery, material science, etc. However, due to the large searching space, it is impossible for human experts…

Machine Learning · Computer Science 2022-03-29 Yuanqi Du , Tianfan Fu , Jimeng Sun , Shengchao Liu

Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Khiem Le , Zhichun Guo , Kaiwen Dong , Xiaobao Huang , Bozhao Nan , Roshni Iyer , Xiangliang Zhang , Olaf Wiest , Wei Wang , Ting Hua , Nitesh V. Chawla

Recently, text-to-molecule models have shown great potential across various chemical applications, e.g., drug-discovery. These models adapt language models to molecular data by representing molecules as sequences of atoms. However, they…

Computation and Language · Computer Science 2025-09-18 Seojin Kim , Hyeontae Song , Jaehyun Nam , Jinwoo Shin

Every molecule ever synthesised can be drawn as a 2D skeletal diagram, yet in modern property prediction this universally available representation has received less focus in favour of molecular graphs, 3D conformers, or billion-parameter…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Aaditya Baranwal , Akshaj Gupta , Shruti Vyas , Yogesh S Rawat

The development of large language models and multi-modal models has enabled the appealing idea of generating novel molecules from text descriptions. Generative modeling would shift the paradigm from relying on large-scale chemical screening…

Machine Learning · Computer Science 2025-08-25 Yifan Deng , Spencer S. Ericksen , Anthony Gitter

Understanding molecules is key to understanding organisms and driving advances in drug discovery, requiring interdisciplinary knowledge across chemistry and biology. Although large molecular language models have achieved notable success in…

Machine Learning · Computer Science 2025-10-03 Dongki Kim , Wonbin Lee , Sung Ju Hwang

Recently, there has been a growing interest among researchers in understanding molecules and their textual descriptions through molecule language models (MoLM). However, despite some early promising developments, the advancement of MoLM…

Artificial Intelligence · Computer Science 2024-07-24 Namkyeong Lee , Siddhartha Laghuvarapu , Chanyoung Park , Jimeng Sun

A proof-of-concept framework for identifying molecules of unknown elemental composition and structure using experimental rotational data and probabilistic deep learning is presented. Using a minimal set of input data determined…

Chemical Physics · Physics 2020-07-01 Michael C. McCarthy , Kin Long Kelvin Lee

The recent advances in neural language models have also been successfully applied to the field of chemistry, offering generative solutions for classical problems in molecular design and synthesis planning. These new methods have the…

Machine Learning · Computer Science 2023-05-19 Dimitrios Christofidellis , Giorgio Giannone , Jannis Born , Ole Winther , Teodoro Laino , Matteo Manica

Deep learning in computational biochemistry has traditionally focused on molecular graphs neural representations; however, recent advances in language models highlight how much scientific knowledge is encoded in text. To bridge these two…

Machine Learning · Computer Science 2023-07-26 Romain Lacombe , Andrew Gaut , Jeff He , David Lüdeke , Kateryna Pistunova

Cross-modal text-molecule retrieval task bridges molecule structures and natural language descriptions. Existing methods predominantly focus on aligning text modality and molecule modality, yet they overlook adaptively adjusting the…

Computation and Language · Computer Science 2025-02-18 Hongyan Wu , Peijian Zeng , Weixiong Zheng , Lianxi Wang , Nankai Lin , Shengyi Jiang , Aimin Yang

Chemical representation learning has gained increasing interest due to the limited availability of supervised data in fields such as drug and materials design. This interest particularly extends to chemical language representation learning,…

Chemical Physics · Physics 2024-08-06 Jun-Hyung Park , Yeachan Kim , Mingyu Lee , Hyuntae Park , SangKeun Lee