English
Related papers

Related papers: MolParser: End-to-end Visual Recognition of Molecu…

200 papers

Optical Chemical Structure Recognition (OCSR) is essential for converting molecular images into machine-readable formats. While recent vision-language models (VLMs) have shown promise, their image-captioning approach often struggles with…

Artificial Intelligence · Computer Science 2026-01-14 Jingchao Wang , Yifan He , Haote Yang , Jiang Wu , Lingli Ge , Xingjian Wei , Yinfan Wang , Linye Li , Huijie Ao , Chengjin Liu , Bin Wang , Lijun Wu , Conghui He

The crucial field of Optical Chemical Structure Recognition (OCSR) aims to transform chemical structure photographs into machine-readable formats so that chemical databases may be efficiently stored and queried. Although a number of OCSR…

Machine Learning · Computer Science 2025-02-25 Zishuo Lin , Jiajie Wang , Zhe Yan , Peiyong Ma

Document parsing has recently advanced with multimodal large language models (MLLMs) that directly map document images to structured outputs. Traditional cascaded pipelines depend on precise layout analysis and often fail under casually…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Gengluo Li , Pengyuan Lyu , Chengquan Zhang , Huawen Shen , Liang Wu , Xingyu Wan , Gangyan Zeng , Han Hu , Can Ma , Yu Zhou

Precise recognition, editing, and generation of molecules are essential prerequisites for both chemists and AI systems tackling various chemical tasks. We present MolLangBench, a comprehensive benchmark designed to evaluate fundamental…

Computation and Language · Computer Science 2026-03-24 Feiyang Cai , Jiahui Bai , Tao Tang , Guijuan He , Joshua Luo , Tianyu Zhu , Srikanth Pilla , Gang Li , Ling Liu , Feng Luo

Molecular property prediction is a fundamental task in computational chemistry with critical applications in drug discovery and materials science. While recent works have explored Large Language Models (LLMs) for this task, they primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Deepan Adak , Yogesh Singh Rawat , Shruti Vyas

Models based on machine learning can enable accurate and fast molecular property predictions, which is of interest in drug discovery and material design. Various supervised machine learning models have demonstrated promising performance,…

Machine Learning · Computer Science 2022-12-15 Jerret Ross , Brian Belgodere , Vijil Chenthamarakshan , Inkit Padhi , Youssef Mroueh , Payel Das

Molecular function is largely determined by structure. Accurately aligning molecular structure with natural language is therefore essential for enabling large language models (LLMs) to reason about downstream chemical tasks. However, the…

Computation and Language · Computer Science 2026-05-11 Feiyang Cai , Guijuan He , Yi Hu , Jingjing Wang , Joshua Luo , Tianyu Zhu , Srikanth Pilla , Gang Li , Ling Liu , Feng Luo

There is increasing adoption of artificial intelligence in drug discovery. However, existing studies use machine learning to mainly utilize the chemical structures of molecules but ignore the vast textual knowledge available in chemistry.…

Machine Learning · Computer Science 2024-01-31 Shengchao Liu , Weili Nie , Chengpeng Wang , Jiarui Lu , Zhuoran Qiao , Ling Liu , Jian Tang , Chaowei Xiao , Anima Anandkumar

Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Khiem Le , Zhichun Guo , Kaiwen Dong , Xiaobao Huang , Bozhao Nan , Roshni Iyer , Xiangliang Zhang , Olaf Wiest , Wei Wang , Ting Hua , Nitesh V. Chawla

Molecule and text representation learning has gained increasing interest due to its potential for enhancing the understanding of chemical information. However, existing models often struggle to capture subtle differences between molecules…

Machine Learning · Computer Science 2025-10-31 Hyuntae Park , Yeachan Kim , SangKeun Lee

Extracting molecular structure-activity relationships (SARs) from scientific literature and patents is essential for drug discovery and materials research. However, this task remains challenging due to heterogeneous document formats and…

Computation and Language · Computer Science 2025-10-14 Jiaxi Zhuang , Kangning Li , Jue Hou , Mingjun Xu , Zhifeng Gao , Hengxing Cai

Nuclear Magnetic Resonance (NMR) spectroscopy is one of the most powerful and widely used tools for molecular structure elucidation in organic chemistry. However, the interpretation of NMR spectra to determine unknown molecular structures…

Chemical Physics · Physics 2025-09-03 Yongqi Jin , Jun-Jie Wang , Fanjie Xu , Xiaohong Ji , Zhifeng Gao , Linfeng Zhang , Guolin Ke , Rong Zhu , Weinan E

Information Extraction from visually rich documents is a challenging task that has gained a lot of attention in recent years due to its importance in several document-control based applications and its widespread commercial value. The…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Mohamed Dhouib , Ghassen Bettaieb , Aymen Shabou

Molecular knowledge resides within three different modalities of information sources: molecular structures, biomedical documents, and knowledge bases. Effective incorporation of molecular knowledge from these modalities holds paramount…

Biomolecules · Quantitative Biology 2023-07-24 Yizhen Luo , Kai Yang , Massimo Hong , Xing Yi Liu , Zaiqing Nie

Like many scientific fields, new chemistry literature has grown at a staggering pace, with thousands of papers released every month. A large portion of chemistry literature focuses on new molecules and reactions between molecules. Most…

Quantitative Methods · Quantitative Biology 2021-09-10 Daniel Campos , Heng Ji

Automated computational analysis of the vast chemical space is critical for numerous fields of research such as drug discovery and material science. Representation learning techniques have recently been employed with the primary objective…

Quantitative Methods · Quantitative Biology 2023-05-26 Atakan Yüksel , Erva Ulusoy , Atabey Ünlü , Tunca Doğan

With the prospect of automating a number of chemical tasks with high fidelity, chemical language processing models are emerging at a rapid speed. Here, we present a cloud-based real-time platform that allows users to virtually screen…

Large language models (LLMs) are increasingly recognized as powerful tools for scientific discovery, particularly in molecular science. A fundamental requirement for these models is the ability to accurately understand molecular structures,…

Machine Learning · Computer Science 2025-05-23 Yunhui Jang , Jaehyung Kim , Sungsoo Ahn

Translating renderings (e. g. PDFs, scans) into hierarchical document structures is extensively demanded in the daily routines of many real-world applications. However, a holistic, principled approach to inferring the complete hierarchical…

Machine Learning · Computer Science 2021-01-26 Johannes Rausch , Octavio Martinez , Fabian Bissig , Ce Zhang , Stefan Feuerriegel

Localizing and recognizing objects in the open-ended physical world poses a long-standing challenge within the domain of machine perception. Recent methods have endeavored to address the issue by employing a class-agnostic mask (or box)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Qihang Yu , Xiaohui Shen , Liang-Chieh Chen