English
Related papers

Related papers: Probabilistic Generative Transformer Language mode…

200 papers

Drug Discovery is a fundamental and ever-evolving field of research. The design of new candidate molecules requires large amounts of time and money, and computational methods are being increasingly employed to cut these costs. Machine…

Machine Learning · Statistics 2021-05-28 Pietro Bongini , Monica Bianchini , Franco Scarselli

Our world is ambiguous and this is reflected in the data we use to train our algorithms. This is particularly true when we try to model natural processes where collected data is affected by noisy measurements and differences in measurement…

Machine Learning · Computer Science 2023-07-19 Jörg K. H. Franke , Frederic Runge , Frank Hutter

The goal of structure-based drug discovery is to find small molecules that bind to a given target protein. Deep learning has been used to generate drug-like molecules with certain cheminformatic properties, but has not yet been applied to…

Quantitative Methods · Quantitative Biology 2022-01-27 Matthew Ragoza , Tomohide Masuda , David Ryan Koes

In the space of only a few years, deep generative modeling has revolutionized how we think of artificial creativity, yielding autonomous systems which produce original images, music, and text. Inspired by these successes, researchers are…

Machine Learning · Computer Science 2019-05-24 Daniel C. Elton , Zois Boukouvalas , Mark D. Fuge , Peter W. Chung

Drug discovery aims to find novel compounds with specified chemical property profiles. In terms of generative modeling, the goal is to learn to sample molecules in the intersection of multiple property constraints. This task becomes…

Machine Learning · Computer Science 2020-07-06 Wengong Jin , Regina Barzilay , Tommi Jaakkola

Recent advances in generative models have made exploring design spaces easier for de novo molecule generation. However, popular generative models like GANs and normalizing flows face challenges such as training instabilities due to…

Designing safe and sustainable chemicals is critical to combat chemical pollution in our environment. Machine learning (ML) methods have been developed to aid with de novo molecule design. However, data on the environmental impacts of…

Human-Computer Interaction · Computer Science 2026-05-18 Coelina Robinson , Franziska Weissbach , Kjell Jorner , Mennatallah El-Assady , Christina Humer

A grand challenge in machine learning is the development of computational algorithms that match or outperform humans in perceptual inference tasks that are complicated by nuisance variation. For instance, visual object recognition involves…

Machine Learning · Statistics 2015-04-03 Ankit B. Patel , Tan Nguyen , Richard G. Baraniuk

Molecule design is a fundamental problem in molecular science and has critical applications in a variety of areas, such as drug discovery, material science, etc. However, due to the large searching space, it is impossible for human experts…

Machine Learning · Computer Science 2022-03-29 Yuanqi Du , Tianfan Fu , Jimeng Sun , Shengchao Liu

Designing new chemical compounds with desired pharmaceutical properties is a challenging task and takes years of development and testing. Still, a majority of new drugs fail to prove efficient. Recent success of deep generative modeling…

Machine Learning · Computer Science 2021-09-15 Karina Zadorozhny , Lada Nuzhna

Recent advancements in computational chemistry have leveraged the power of trans-former-based language models, such as MoLFormer, pre-trained using a vast amount of simplified molecular-input line-entry system (SMILES) sequences, to…

Biomolecules · Quantitative Biology 2024-11-05 Tianhao Peng , Yuchen Li , Xuhong Li , Jiang Bian , Zeke Xie , Ning Sui , Shahid Mumtaz , Yanwu Xu , Linghe Kong , Haoyi Xiong

Recent advancements in specialized large-scale architectures for training image and language have profoundly impacted the field of computer vision and natural language processing (NLP). Language models, such as the recent ChatGPT and GPT4…

Biomolecules · Quantitative Biology 2023-05-04 Sergio Romero-Romero , Sebastian Lindner , Noelia Ferruz

Transformers have become methods of choice in many applications thanks to their ability to represent complex interactions between elements. However, extending the Transformer architecture to non-sequential data such as molecules and…

Machine Learning · Computer Science 2022-04-27 Yoni Choukroun , Lior Wolf

Materials discovery is decisive for tackling urgent challenges related to energy, the environment, health care and many others. In chemistry, conventional methodologies for innovation usually rely on expensive and incremental strategies to…

Machine Learning · Computer Science 2020-06-09 Daniel Schwalbe-Koda , Rafael Gómez-Bombarelli

Discovery of novel and promising materials is a critical challenge in the field of chemistry and material science, traditionally approached through methodologies ranging from trial-and-error to machine learning-driven inverse design. Recent…

Machine Learning · Computer Science 2024-12-13 Dong Hyeon Mok , Seoin Back

Deep generative models such as diffusion and flow matching are powerful machine learning tools capable of learning and sampling from high-dimensional distributions. They are particularly useful when the training data appears to be…

High Energy Physics - Phenomenology · Physics 2026-04-30 Zachary Bogorad , Ibrahim Elsharkawy , Yonatan Kahn , Andrew J. Larkoski , Noam Levi

Is there a unified model for generating molecules considering different conditions, such as binding pockets and chemical properties? Although target-aware generative models have made significant advances in drug design, they do not consider…

Artificial Intelligence · Computer Science 2023-02-15 Zhangyang Gao , Yuqi Hu , Cheng Tan , Stan Z. Li

Large language models (LLMs) are having transformative impacts across a wide range of scientific fields, particularly in the biomedical sciences. Just as the goal of Natural Language Processing is to understand sequences of words, a major…

Genomics · Quantitative Biology 2024-09-24 Gonzalo Benegas , Chengzhong Ye , Carlos Albors , Jianan Canal Li , Yun S. Song

A range of generative machine learning models for the design of novel molecules and materials have been proposed in recent years. Models that can generate three-dimensional structures are particularly suitable for quantum chemistry…

The goal of generative machine learning is to model the probability distribution underlying a given data set. This probability distribution helps to characterize the generation process of the data samples. While classical generative machine…

Quantum Physics · Physics 2021-11-29 Christa Zoufal