English
Related papers

Related papers: IMG2SMI: Translating Molecular Structure Images to…

200 papers

Optical Chemical Structure Recognition (OCSR) plays a pivotal role in modern chemical informatics, enabling the automated conversion of chemical structure images from scientific literature, patents, and educational materials into…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Wenrui Zhang , Xinggang Wang , Bin Feng , Wenyu Liu

In this paper, we aim to synthesize cell microscopy images under different molecular interventions, motivated by practical applications to drug development. Building on the recent success of graph neural networks for learning molecular…

Biomolecules · Quantitative Biology 2020-06-16 Karren Yang , Samuel Goldman , Wengong Jin , Alex Lu , Regina Barzilay , Tommi Jaakkola , Caroline Uhler

An image dataset of 10 different size molecules, where each molecule has 2,000 structural variants, is generated from the 2D cross-sectional projection of Molecular Dynamics trajectories. The purpose of this dataset is to provide a…

Image and Video Processing · Electrical Eng. & Systems 2019-11-19 Yan Zhang , Steve Farrell , Michael Crowley , Lee Makowski , Jack Deslippe

Molecule pretraining has quickly become the go-to schema to boost the performance of AI-based drug discovery. Naturally, molecules can be represented as 2D topological graphs or 3D geometric point clouds. Although most existing pertaining…

Machine Learning · Computer Science 2025-02-10 Shengchao Liu , Weitao Du , Zhiming Ma , Hongyu Guo , Jian Tang

Masked image modelling (MIM) is a powerful self-supervised representation learning paradigm, whose potential has not been widely demonstrated in medical image analysis. In this work, we show the capacity of MIM to capture rich semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Piotr Wójcik , Hussein Naji , Adrian Simon , Reinhard Büttner , Katarzyna Bożek

Chemical structure extraction from documents remains a hard problem due to both false positive identification of structures during segmentation and errors in the predicted structures. Current approaches rely on handcrafted rules and…

Machine Learning · Computer Science 2018-02-15 Joshua Staker , Kyle Marshall , Robert Abel , Carolyn McQuaw

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

The quest for accurate prediction of drug molecule properties poses a fundamental challenge in the realm of Artificial Intelligence Drug Discovery (AIDD). An effective representation of drug molecules emerges as a pivotal component in this…

Machine Learning · Computer Science 2024-04-22 Zhuoyuan Wang , Jiacong Mi , Shan Lu , Jieyue He

Text-to-image (T2I) models have ushered in a new era of real-world image super-resolution (Real-ISR) due to their rich internal implicit knowledge for multimodal learning. Although bringing high-level semantic priors and dense pixel…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Xinrui Li , Jinrong Zhang , Jianlong Wu , Chong Chen , Liqiang Nie , Zhouchen Lin

In recent decades, chemistry publications and patents have increased rapidly. A significant portion of key information is embedded in molecular structure figures, complicating large-scale literature searches and limiting the application of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Xi Fang , Jiankun Wang , Xiaochen Cai , Shangqian Chen , Shuwen Yang , Haoyi Tao , Nan Wang , Lin Yao , Linfeng Zhang , Guolin Ke

De novo design of molecules has recently enjoyed the power of generative deep neural networks. Current approaches aim to generate molecules either resembling the properties of the molecules of the training set or molecules that are…

Biomolecules · Quantitative Biology 2020-11-02 Ahmadreza Ghanbarpour , Markus A. Lill

Generative models have achieved impressive results in many domains including image and text generation. In the natural sciences, generative models have led to rapid progress in automated drug discovery. Many of the current methods focus on…

Machine Learning · Computer Science 2019-09-04 Jordan Hoffmann , Louis Maestrati , Yoshihide Sawada , Jian Tang , Jean Michel Sellier , Yoshua Bengio

In this work we apply methods for describing 3D images to the problem of encoding atomic environments in a way that is invariant to rotations, translations, and permutations of the atoms and, crucially, can be decoded back into the original…

Materials Science · Physics 2021-10-28 Martin Uhrin

Chemical databases store information in text representations, and the SMILES format is a universal standard used in many cheminformatics software. Encoded in each SMILES string is structural information that can be used to predict complex…

Machine Learning · Statistics 2018-08-16 Garrett B. Goh , Nathan O. Hodas , Charles Siegel , Abhinav Vishnu

Automated computational analysis of the vast chemical space is critical for numerous fields of research such as drug discovery and material science. Representation learning techniques have recently been employed with the primary objective…

Quantitative Methods · Quantitative Biology 2023-05-26 Atakan Yüksel , Erva Ulusoy , Atabey Ünlü , Tunca Doğan

In the intersection of molecular science and deep learning, tasks like virtual screening have driven the need for a high-throughput molecular representation generator on large chemical databases. However, as SMILES strings are the most…

Computational Engineering, Finance, and Science · Computer Science 2021-12-28 Wenhao Zhu , Ziyao Li , Lingsheng Cai , Guojie Song

Simplified Molecular Input Line Entry System (SMILES) is a single line text representation of a unique molecule. One molecule can however have multiple SMILES strings, which is a reason that canonical SMILES have been defined, which ensures…

Machine Learning · Computer Science 2017-05-18 Esben Jannik Bjerrum

Recent advancements in computational chemistry have leveraged the power of trans-former-based language models, such as MoLFormer, pre-trained using a vast amount of simplified molecular-input line-entry system (SMILES) sequences, to…

Biomolecules · Quantitative Biology 2024-11-05 Tianhao Peng , Yuchen Li , Xuhong Li , Jiang Bian , Zeke Xie , Ning Sui , Shahid Mumtaz , Yanwu Xu , Linghe Kong , Haoyi Xiong

Every molecule ever synthesised can be drawn as a 2D skeletal diagram, yet in modern property prediction this universally available representation has received less focus in favour of molecular graphs, 3D conformers, or billion-parameter…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Aaditya Baranwal , Akshaj Gupta , Shruti Vyas , Yogesh S Rawat

Spectroscopic techniques are essential tools for determining the structure of molecules. Different spectroscopic techniques, such as Nuclear magnetic resonance (NMR), Infrared spectroscopy, and Mass Spectrometry, provide insight into the…

Chemical Physics · Physics 2024-10-30 Marvin Alberts , Oliver Schilter , Federico Zipoli , Nina Hartrampf , Teodoro Laino