English
Related papers

Related papers: A Hitchhiker's Guide to Deep Chemical Language Pro…

200 papers

This literature review studies the field of automated process extraction, i.e., transforming textual descriptions into structured processes using Natural Language Processing (NLP). We found that Machine Learning (ML) / Deep Learning (DL)…

Computation and Language · Computer Science 2024-09-24 William Van Woensel , Soroor Motie

Natural language processing (NLP) is an area of artificial intelligence that applies information technologies to process the human language, understand it to a certain degree, and use it in various applications. This area has rapidly…

This paper shows how one can directly apply natural language processing (NLP) methods to classification problems in cheminformatics. Connection between these seemingly separate fields is shown by considering standard textual representation…

Computation and Language · Computer Science 2018-03-09 Stanisław Jastrzębski , Damian Leśniak , Wojciech Marian Czarnecki

Boosted by deep learning, natural language processing (NLP) techniques have recently seen spectacular progress, mainly fueled by breakthroughs both in representation learning with word embeddings (e.g. word2vec) as well as novel…

Networking and Internet Architecture · Computer Science 2022-07-26 Zied Ben Houidi , Dario Rossi

Activity and property prediction models are the central workhorses in drug discovery and materials sciences, but currently they have to be trained or fine-tuned for new tasks. Without training or fine-tuning, scientific language models…

Biomolecules · Quantitative Biology 2023-06-19 Philipp Seidl , Andreu Vall , Sepp Hochreiter , Günter Klambauer

Deep learning is now widely used in drug discovery, providing significant acceleration and cost reduction. As the most fundamental building block, molecular representation is essential for predicting molecular properties to enable various…

Machine Learning · Computer Science 2024-04-22 Haoqiang Guo , Sendong Zhao , Haochun Wang , Yanrui Du , Bing Qin

Despite advances in machine learning (ML) and large language models (LLMs), rule-based natural language processing (NLP) systems remain active in clinical settings due to their interpretability and operational efficiency. However, their…

Computation and Language · Computer Science 2025-06-23 Jianlin Shi , Brian T. Bucher

Prediction of complete step-by-step chemical reaction mechanisms (CRMs) remains a major challenge. Whereas the traditional approaches in CRM tasks rely on expert-driven experiments or costly quantum chemical computations, contemporary deep…

Chemical Physics · Physics 2025-12-11 Manajit Das , Ajnabiul Hoque , Mayank Baranwal , Raghavan B. Sunoj

Deep Learning (DL) algorithms hold great promise for applications in the field of computational biophysics. In fact, the vast amount of available molecular structures, as well as their notable complexity, constitutes an ideal context in…

Soft Condensed Matter · Physics 2019-01-07 Marco Giulini , Raffaello Potestio

With the development of computer-assisted techniques, research communities including biochemistry and deep learning have been devoted into the drug discovery field for over a decade. Various applications of deep learning have drawn great…

Machine Learning · Computer Science 2023-03-07 Wenhao Hu , Yingying Liu , Xuanyu Chen , Wenhao Chai , Hangyue Chen , Hongwei Wang , Gaoang Wang

Deep neural-network-based language models (LMs) are increasingly applied to large-scale protein sequence data to predict protein function. However, being largely black-box models and thus challenging to interpret, current protein LM…

Quantitative Methods · Quantitative Biology 2024-08-06 Mai Ha Vu , Rahmad Akbar , Philippe A. Robert , Bartlomiej Swiatczak , Victor Greiff , Geir Kjetil Sandve , Dag Trygve Truslew Haug

As vast databases of chemical identities become increasingly available, the challenge shifts to how we effectively explore and leverage these resources to study molecular properties. This paper presents an active learning approach for…

Machine Learning · Computer Science 2025-07-17 Ayana Ghosh , Maxim Ziatdinov , Sergei V. Kalinin

Many search systems work with large amounts of natural language data, e.g., search queries, user profiles, and documents. Building a successful search system requires a thorough understanding of textual data semantics, where deep learning…

Information Retrieval · Computer Science 2021-08-31 Weiwei Guo , Xiaowei Liu , Sida Wang , Michaeel Kazi , Zhiwei Wang , Zhoutong Fu , Jun Jia , Liang Zhang , Huiji Gao , Bo Long

Virtual screening plays a critical role in modern drug discovery by enabling the identification of promising candidate molecules for experimental validation. Traditional machine learning methods such, as Support Vector Machines (SVM) and…

Machine Learning · Computer Science 2025-04-29 Radia Berreziga , Mohammed Brahimi , Khairedine Kraim , Hamid Azzoune

Accurately predicting chemical reactions is essential for driving innovation in synthetic chemistry, with broad applications in medicine, manufacturing, and agriculture. At the same time, reaction prediction is a complex problem which can…

Machine Learning · Computer Science 2025-04-23 Ryan J. Miller , Alexander E. Dashuta , Brayden Rudisill , David Van Vranken , Pierre Baldi

Despite their ability to understand chemical knowledge, large language models (LLMs) remain limited in their capacity to propose novel molecules with desired functions (e.g., drug-like properties). In addition, the molecules that LLMs…

Virtual screening can accelerate drug discovery by identifying promising candidates for experimental evaluation. Machine learning is a powerful method for screening, as it can learn complex structure-property relationships from experimental…

Machine Learning · Computer Science 2021-02-22 Simon Axelrod , Rafael Gomez-Bombarelli

Natural Language Processing (NLP) is widely used in fields like machine translation and sentiment analysis. However, traditional NLP models struggle with accuracy and efficiency. This paper introduces Deep Convolutional Neural Networks…

Computation and Language · Computer Science 2024-12-23 Chang Weng , Scott Rood , Mehdi Ali Ramezani , Amir Aslani , Reza Zarrab , Wang Zwuo , Sanjeev Salimans , Tim Satheesh

Machine learning has transformed material discovery for inorganic compounds and small molecules, yet polymers remain largely inaccessible to these methods. While data scarcity is often cited as the primary bottleneck, we demonstrate that…

Machine Learning · Computer Science 2025-12-09 Jihun Ahn , Gabriella Pasya Irianti , Vikram Thapar , Su-Mi Hur

The extraction of interactions between chemicals and proteins from several biomedical articles is important in many fields of biomedical research such as drug development and prediction of drug side effects. Several natural language…

Computation and Language · Computer Science 2020-11-05 Dongha Choi , Hyunju Lee