English
Related papers

Related papers: IMG2SMI: Translating Molecular Structure Images to…

200 papers

Molecule generation is a very important practical problem, with uses in drug discovery and material design, and AI methods promise to provide useful solutions. However, existing methods for molecule generation focus either on 2D graph…

Machine Learning · Computer Science 2024-02-07 Chenqing Hua , Sitao Luan , Minkai Xu , Rex Ying , Jie Fu , Stefano Ermon , Doina Precup

In this work, we propose a simple transformer-based baseline for multimodal molecular representation learning, integrating three distinct modalities: SMILES strings, 2D graph representations, and 3D conformers of molecules. A key aspect of…

Machine Learning · Computer Science 2024-10-25 Andrei Manolache , Dragos Tantaru , Mathias Niepert

The field of bioinformatics has seen significant progress, making the cross-modal text-molecule retrieval task increasingly vital. This task focuses on accurately retrieving molecule structures based on textual descriptions, by effectively…

Information Retrieval · Computer Science 2024-11-20 Zijun Min , Bingshuai Liu , Liang Zhang , Jia Song , Jinsong Su , Song He , Xiaochen Bo

Automatic extraction of chemical structures from scientific literature plays a crucial role in accelerating research across fields ranging from drug discovery to materials science. Patent documents, in particular, contain molecular…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Lucas Morin , Gerhard Ingmar Meijer , Valéry Weber , Luc Van Gool , Peter W. J. Staar

A vast majority of mass spectrometry data remains uncharacterized, leaving much of its biological and chemical information untapped. Recent advances in machine learning have begun to address this gap, particularly for tasks such as spectral…

This work introduces MiDi, a novel diffusion model for jointly generating molecular graphs and their corresponding 3D arrangement of atoms. Unlike existing methods that rely on predefined rules to determine molecular bonds based on the 3D…

Machine Learning · Computer Science 2023-06-06 Clement Vignac , Nagham Osman , Laura Toni , Pascal Frossard

Molecular language modeling tasks such as molecule captioning have been recognized for their potential to further understand molecular properties that can aid drug discovery or material synthesis based on chemical reactions. Unlike the…

Machine Learning · Computer Science 2025-03-12 Sangyeup Kim , Nayeon Kim , Yinhua Piao , Sun Kim

The short and intense pulses of the new X-ray free electron lasers, now operational or under construction, may make possible diffraction experiments on single molecule-sized objects with high resolution, before radiation damage destroys the…

Data Analysis, Statistics and Probability · Physics 2012-04-11 Miklós Tegze , Gábor Bortel

Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Khiem Le , Zhichun Guo , Kaiwen Dong , Xiaobao Huang , Bozhao Nan , Roshni Iyer , Xiangliang Zhang , Olaf Wiest , Wei Wang , Ting Hua , Nitesh V. Chawla

A proof-of-concept framework for identifying molecules of unknown elemental composition and structure using experimental rotational data and probabilistic deep learning is presented. Using a minimal set of input data determined…

Chemical Physics · Physics 2020-07-01 Michael C. McCarthy , Kin Long Kelvin Lee

Molecule design is a multifaceted approach that leverages computational methods and experiments to optimize molecular properties, fast-tracking new drug discoveries, innovative material development, and more efficient chemical processes.…

Computation and Language · Computer Science 2024-08-23 Sakhinana Sagar Srinivas , Venkataramana Runkana

In recent years, self-supervised learning has emerged as a powerful tool to harness abundant unlabelled data for representation learning and has been broadly adopted in diverse areas. However, when applied to molecular representation…

Machine Learning · Computer Science 2024-02-22 Han Tang , Shikun Feng , Bicheng Lin , Yuyan Ni , JIngjing Liu , Wei-Ying Ma , Yanyan Lan

DScribe is a software package for machine learning that provides popular feature transformations ("descriptors") for atomistic materials simulations. DScribe accelerates the application of machine learning for atomistic property prediction…

While Large Language Models (LLMs) have revolutionized scientific text processing, they exhibit a significant capability gap when interpreting chemical reaction diagrams. We identify two fundamental bottlenecks restricting current systems:…

Artificial Intelligence · Computer Science 2026-05-19 Mingyang Rao , Kehua Feng , Zhihui Zhu , Jiangzhen Fu , Hao Yu , Keyan Ding , Huajun Chen

We introduce SigLIP 2, a family of new multilingual vision-language encoders that build on the success of the original SigLIP. In this second iteration, we extend the original image-text training objective with several prior, independently…

Molecular representation learning plays an essential role in cheminformatics. Recently, language model-based approaches have gained popularity as an alternative to traditional expert-designed features to encode molecules. However, these…

Machine Learning · Computer Science 2022-04-19 Zhihui Guo , Pramod Sharma , Andy Martinez , Liang Du , Robin Abraham

Molecular structure elucidation from spectroscopic data is a long-standing challenge in Chemistry, traditionally requiring expert interpretation. We introduce NMIRacle, a two-stage generative framework that builds upon recent paradigms in…

Chemical Physics · Physics 2026-03-12 Federico Ottomano , Yingzhen Li , Alex M. Ganose

In the era of large-scale visual data, understanding collections of images is a challenging yet important task. To this end, we introduce ImageSet2Text, a novel method to automatically generate natural language descriptions of image sets.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Piera Riccio , Francesco Galati , Kajetan Schweighofer , Noa Garcia , Nuria Oliver

We introduce Image2Struct, a benchmark to evaluate vision-language models (VLMs) on extracting structure from images. Our benchmark 1) captures real-world use cases, 2) is fully automatic and does not require human judgment, and 3) is based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Josselin Somerville Roberts , Tony Lee , Chi Heem Wong , Michihiro Yasunaga , Yifan Mai , Percy Liang

Recently, the impressive performance of large language models (LLMs) on a wide range of tasks has attracted an increasing number of attempts to apply LLMs in drug discovery. However, molecule optimization, a critical task in the drug…

Quantitative Methods · Quantitative Biology 2024-01-22 Geyan Ye , Xibao Cai , Houtim Lai , Xing Wang , Junhong Huang , Longyue Wang , Wei Liu , Xiangxiang Zeng