English
Related papers

Related papers: SELFormer: Molecular Representation Learning via S…

200 papers

Molecular representation learning has become a central approach in AI-driven drug discovery, yet existing molecular tokenizations such as SMILES remain largely syntactic and do not naturally align with chemically meaningful substructures.…

Machine Learning · Computer Science 2026-05-19 Takayuki Kimura

Molecular deep learning models have achieved remarkable success in property prediction, but they often require large amounts of labeled data. The challenge is that, in real-world applications, labels are extremely scarce, as obtaining them…

Machine Learning · Computer Science 2025-07-21 Kevin Tirta Wijaya , Minghao Guo , Michael Sun , Hans-Peter Seidel , Wojciech Matusik , Vahid Babaei

Molecular representations fundamentally shape how machine learning systems reason about molecular structure and physical properties. Most existing approaches adopt a discrete pipeline: molecules are encoded as sequences, graphs, or point…

Semiparametric language models (LMs) have shown promise in continuously learning from new text data by combining a parameterized neural LM with a growable non-parametric memory for memorizing new content. However, conventional…

Computation and Language · Computer Science 2023-03-03 Guangyue Peng , Tao Ge , Si-Qing Chen , Furu Wei , Houfeng Wang

Understanding how chemical language models (CLMs) learn chemical meaning from molecular string representations, rather than only surface-level string patterns, is an important question in chemical representation learning and machine…

Machine Learning · Computer Science 2026-05-12 Zehao Li , Yasuhiro Yoshikai , Shumpei Nemoto , Hiroyuki Kusuhara , Tadahaya Mizuno

Molecule-and-text cross-modal representation learning has emerged as a promising direction for enhancing the quality of molecular representation, thereby improving performance in various scientific fields. However, most approaches employ a…

Quantitative Methods · Quantitative Biology 2025-03-04 Yikun Zhang , Geyan Ye , Chaohao Yuan , Bo Han , Long-Kai Huang , Jianhua Yao , Wei Liu , Yu Rong

Molecular representation is a critical element in our understanding of the physical world and the foundation for modern molecular machine learning. Previous molecular machine learning models have employed strings, fingerprints, global…

Machine Learning · Computer Science 2025-05-28 Daniil A. Boiko , Thiago Reschützegger , Benjamin Sanchez-Lengeling , Samuel M. Blau , Gabe Gomes

Recent advancements in Multimodal Large Language Models (MLLMs) have revolutionized the field of vision-language understanding by integrating visual perception capabilities into Large Language Models (LLMs). The prevailing trend in this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Sirnam Swetha , Jinyu Yang , Tal Neiman , Mamshad Nayeem Rizve , Son Tran , Benjamin Yao , Trishul Chilimbi , Mubarak Shah

We propose a novel method enabling autocompletion of chemical flowsheets. This idea is inspired by the autocompletion of text. We represent flowsheets as strings using the text-based SFILES 2.0 notation and learn the grammatical structure…

Machine Learning · Computer Science 2024-01-17 Gabriel Vogel , Lukas Schulze Balhorn , Artur M. Schweidtmann

Large Language Models (LLMs) have shown impressive performance across various domains, but their ability to perform molecular reasoning remains underexplored. Existing methods mostly rely on general-purpose prompting, which lacks…

Providing explainable molecular property predictions is critical for many scientific domains, such as drug discovery and material science. Though transformer-based language models have shown great potential in accurate molecular property…

Machine Learning · Computer Science 2026-01-14 Zhenzhong Wang , Zehui Lin , Wanyu Lin , Ming Yang , Minggang Zeng , Kay Chen Tan

Using generative deep learning models and reinforcement learning together can effectively generate new molecules with desired properties. By employing a multi-objective scoring function, thousands of high-scoring molecules can be generated,…

Accurate and efficient prediction of polymer properties is of great significance in polymer design. Conventionally, expensive and time-consuming experiments or simulations are required to evaluate polymer functions. Recently, Transformer…

Machine Learning · Computer Science 2023-04-27 Changwen Xu , Yuyang Wang , Amir Barati Farimani

The quantum Hamiltonian is a fundamental property that governs a molecule's electronic structure and behavior, and its calculation and prediction are paramount in computational chemistry and materials science. Accurate prediction is highly…

Computational Engineering, Finance, and Science · Computer Science 2026-01-23 Zhenzhong Wang , Yongjie Hou , Chenggong Huang , Yuxuan Du , Dacheng Tao , Min Jiang

Identifying the chemical structure from a graphical representation, or image, of a molecule is a challenging pattern recognition task that would greatly benefit drug development. Yet, existing methods for chemical structure recognition do…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Martijn Oldenhof , Edward De Brouwer , Adam Arany , Yves Moreau

A proof-of-concept framework for identifying molecules of unknown elemental composition and structure using experimental rotational data and probabilistic deep learning is presented. Using a minimal set of input data determined…

Chemical Physics · Physics 2020-07-01 Michael C. McCarthy , Kin Long Kelvin Lee

We discover a robust self-supervised strategy tailored towards molecular representations for generative masked language models through a series of tailored, in-depth ablations. Using this pre-training strategy, we train BARTSmiles, a…

With the emergence of Transformer architectures and their powerful understanding of textual data, a new horizon has opened up to predict the molecular properties based on text description. While SMILES are the most common form of…

Chemical Physics · Physics 2023-10-11 Suryanarayanan Balaji , Rishikesh Magar , Yayati Jadhav , Amir Barati Farimani

In recent years, Large Language Models (LLMs) have achieved significant success in natural language processing (NLP) and various interdisciplinary areas. However, applying LLMs to chemistry is a complex task that requires specialized domain…

Machine Learning · Computer Science 2024-02-05 Chang Liao , Yemin Yu , Yu Mei , Ying Wei

The need for analysis of toxicity in new drug candidates and the requirement of doing it fast have asked the consideration of scientists towards the use of artificial intelligence tools to examine toxicity levels and to develop models to a…

Quantitative Methods · Quantitative Biology 2021-01-27 Mriganka Nath , Subhasish Goswami
‹ Prev 1 4 5 6 7 8 10 Next ›