English
Related papers

Related papers: IMG2SMI: Translating Molecular Structure Images to…

200 papers

Molecular structures are always depicted as 2D printed form in scientific documents like journal papers and patents. However, these 2D depictions are not machine-readable. Due to a backlog of decades and an increasing amount of these…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Youjun Xu , Jinchuan Xiao , Chia-Han Chou , Jianhang Zhang , Jintao Zhu , Qiwan Hu , Hemin Li , Ningsheng Han , Bingyu Liu , Shuaipeng Zhang , Jinyu Han , Zhen Zhang , Shuhao Zhang , Weilin Zhang , Luhua Lai , Jianfeng Pei

Optical chemical structure recognition (OCSR) systems aim to extract the molecular structure information, usually in the form of molecular graph or SMILES, from images of chemical molecules. While many tools have been developed for this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Ching Ting Leung , Yufan Chen , Hanyu Gao

Understanding the chemical structure from a graphical representation of a molecule is a challenging image caption task that would greatly benefit molecule-centric scientific discovery. Variations in molecular images and caption subtasks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Siqi Fan , Yuguang Xie , Bowen Cai , Ailin Xie , Gaochao Liu , Mu Qiao , Jie Xing , Zaiqing Nie

Optical Chemical Structure Recognition (OCSR) is critical for converting 2D molecular diagrams from printed literature into machine-readable formats. While Vision-Language Models have shown promise in end-to-end OCR tasks, their direct…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Haocheng Tang , Xingyu Dang , Junmei Wang

For several decades, chemical knowledge has been published in written text, and there have been many attempts to make it accessible, for example, by transforming such natural language text to a structured format. Although the discovered…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Sanghyun Yoo , Ohyun Kwon , Hoshik Lee

Identifying the chemical structure from a graphical representation, or image, of a molecule is a challenging pattern recognition task that would greatly benefit drug development. Yet, existing methods for chemical structure recognition do…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Martijn Oldenhof , Edward De Brouwer , Adam Arany , Yves Moreau

Molecular structure recognition is the task of translating a molecular image into its graph structure. Significant variation in drawing styles and conventions exhibited in chemical literature poses a significant challenge for automating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Yujie Qian , Jiang Guo , Zhengkai Tu , Zhening Li , Connor W. Coley , Regina Barzilay

Representing molecular structures effectively in chemistry remains a challenging task. Language models and graph-based models are extensively utilized within this domain, consistently achieving state-of-the-art results across an array of…

Machine Learning · Computer Science 2025-05-27 Nikolai Rekut , Alexey Orlov , Klea Ziu , Elizaveta Starykh , Martin Takac , Aleksandr Beznosikov

In the field of chemical structure recognition, the task of converting molecular images into machine-readable data formats such as SMILES string stands as a significant challenge, primarily due to the varied drawing styles and conventions…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yufan Chen , Ching Ting Leung , Yong Huang , Jianwei Sun , Hao Chen , Hanyu Gao

AI models for drug discovery and chemical literature mining must interpret molecular images and generate outputs consistent with 3D geometry and stereochemistry. Most molecular language models rely on strings or graphs, while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Jing Lan , Hexiao Ding , Hongzhao Chen , Yufeng Jiang , Nga-Chun Ng , Gwing Kei Yip , Gerald W. Y. Cheng , Yunlin Mao , Jing Cai , Liang-ting Lin , Jung Sun Yoo

Accurately assessing image complexity (IC) is critical for computer vision, yet most existing methods rely solely on visual features and often neglect high-level semantic information, limiting their accuracy and generalization. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Shipeng Liu , Zhonglin Zhang , Dengfeng Chen , Liang Zhao

Drug discovery projects entail cycles of design, synthesis, and testing that yield a series of chemically related small molecules whose properties, such as binding affinity to a given target protein, are progressively tailored to a…

Machine Learning · Computer Science 2020-02-10 Paul Maragakis , Hunter Nisonoff , Brian Cole , David E. Shaw

To mitigate the potential adverse health effects of simultaneous multi-drug use, including unexpected side effects and interactions, accurately identifying and predicting drug-drug interactions (DDIs) is considered a crucial task in the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yuqin He , Tengfei Ma , Chaoyi Li , Pengsen Ma , Hongxin Xiang , Jianmin Wang , Yiping Liu , Bosheng Song , Xiangxiang Zeng

Automatically extracting chemical structures from documents is essential for the large-scale analysis of the literature in chemistry. Automatic pipelines have been developed to recognize molecules represented either in figures or in text…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Tim Strohmeyer , Lucas Morin , Gerhard Ingmar Meijer , Valéry Weber , Ahmed Nassar , Peter Staar

There is increasing adoption of artificial intelligence in drug discovery. However, existing studies use machine learning to mainly utilize the chemical structures of molecules but ignore the vast textual knowledge available in chemistry.…

Machine Learning · Computer Science 2024-01-31 Shengchao Liu , Weili Nie , Chengpeng Wang , Jiarui Lu , Zhuoran Qiao , Ling Liu , Jian Tang , Chaowei Xiao , Anima Anandkumar

Despite being the main tool to visualize molecules at the atomic scale, AFM with CO-functionalized metal tips is unable to chemically identify the observed molecules. Here we present a strategy to address this challenging task using deep…

Materials Science · Physics 2025-09-03 Jaime Carracedo-Cosme , Carlos Romero-Muñiz , Pablo Pou , Rubén Pérez

SMILES is a linear representation of chemical structures which encodes the connection table, and the stereochemistry of a molecule as a line of text with a grammar structure denoting atoms, bonds, rings and chains, and this information can…

Machine Learning · Computer Science 2018-12-03 Arindam Paul , Dipendra Jha , Reda Al-Bahrani , Wei-keng Liao , Alok Choudhary , Ankit Agrawal

The extraction of molecular structures and reaction data from scientific documents is challenging due to their varied, unstructured chemical formats and complex document layouts. To address this, we introduce MolMole, a vision-based deep…

In drug-discovery-related tasks such as virtual screening, machine learning is emerging as a promising way to predict molecular properties. Conventionally, molecular fingerprints (numerical representations of molecules) are calculated…

Machine Learning · Computer Science 2019-11-13 Shion Honda , Shoi Shi , Hiroki R. Ueda

Most molecular diagram parsers recover chemical structure from raster images (e.g., PNGs). However, many PDFs include commands giving explicit locations and shapes for characters, lines, and polygons. We present a new parser that uses these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Ayush Kumar Shah , Bryan Manrique Amador , Abhisek Dey , Ming Creekmore , Blake Ocampo , Scott Denmark , Richard Zanibbi
‹ Prev 1 2 3 10 Next ›