English
Related papers

Related papers: Probabilistic Generative Transformer Language mode…

200 papers

We study a fundamental problem in structure-based drug design -- generating molecules that bind to specific protein binding sites. While we have witnessed the great success of deep generative models in drug design, the existing methods are…

Biomolecules · Quantitative Biology 2022-11-15 Shitong Luo , Jiaqi Guan , Jianzhu Ma , Jian Peng

Generative modeling, which learns joint probability distribution from data and generates samples according to it, is an important task in machine learning and artificial intelligence. Inspired by probabilistic interpretation of quantum…

Statistical Mechanics · Physics 2018-07-20 Zhao-Yu Han , Jun Wang , Heng Fan , Lei Wang , Pan Zhang

Generative pre-trained Transformer (GPT) has demonstrates its great success in natural language processing and related techniques have been adapted into molecular modeling. Considering that text is the most important record for scientific…

Computation and Language · Computer Science 2023-05-29 Zequn Liu , Wei Zhang , Yingce Xia , Lijun Wu , Shufang Xie , Tao Qin , Ming Zhang , Tie-Yan Liu

We propose a new probabilistic framework that allows mobile robots to autonomously learn deep, generative models of their environments that span multiple levels of abstraction. Unlike traditional approaches that combine engineered models…

Robotics · Computer Science 2018-01-01 Andrzej Pronobis , Rajesh P. N. Rao

Although generative models hold promise for discovering molecules with optimized desired properties, they often fail to suggest synthesizable molecules that improve upon the known molecules seen in training. We find that a key limitation is…

Machine Learning · Computer Science 2025-01-07 Evan R. Antoniuk , Peggy Li , Nathan Keilbart , Stephen Weitzner , Bhavya Kailkhura , Anna M. Hiszpanski

We study unsupervised learning by developing introspective generative modeling (IGM) that attains a generator using progressively learned deep convolutional neural networks. The generator is itself a discriminator, capable of introspection:…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Justin Lazarow , Long Jin , Zhuowen Tu

We propose Generative Probabilistic Image Colorization, a diffusion-based generative process that trains a sequence of probabilistic models to reverse each step of noise corruption. Given a line-drawing image as input, our method suggests…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Chie Furusawa , Shinya Kitaoka , Michael Li , Yuri Odagiri

Beyond their origin in modeling many-body quantum systems, tensor networks have emerged as a promising class of models for solving machine learning problems, notably in unsupervised generative learning. While possessing many desirable…

Machine Learning · Computer Science 2024-07-26 Alex Meiburg , Jing Chen , Jacob Miller , Raphaëlle Tihon , Guillaume Rabusseau , Alejandro Perdomo-Ortiz

Molecules play a crucial role in biomedical research and discovery, particularly in the field of small molecule drug development. Given the rapid advancements in large language models, especially the recent emergence of reasoning models, it…

Artificial Intelligence · Computer Science 2025-12-12 Chenyang Zuo , Siqi Fan , Zaiqing Nie

This work introduces a method to tune a sequence-based generative model for molecular de novo design that through augmented episodic likelihood can learn to generate structures with certain specified desirable properties. We demonstrate how…

Artificial Intelligence · Computer Science 2017-08-30 Marcus Olivecrona , Thomas Blaschke , Ola Engkvist , Hongming Chen

While various models and computational tools have been proposed for structure and property analysis of molecules, generating molecules that conform to all desired structures and properties remains a challenge. Here, we introduce a…

Computation and Language · Computer Science 2024-10-11 Peng Zhou , Jianmin Wang , Chunyan Li , Zixu Wang , Yiping Liu , Siqi Sun , Jianxin Lin , Leyi Wei , Xibao Cai , Houtim Lai , Wei Liu , Longyue Wang , Yuansheng Liu , Xiangxiang Zeng

How to obtain informative representations of molecules is a crucial prerequisite in AI-driven drug design and discovery. Recent researches abstract molecules as graphs and employ Graph Neural Networks (GNNs) for molecular representation…

Biomolecules · Quantitative Biology 2020-10-30 Yu Rong , Yatao Bian , Tingyang Xu , Weiyang Xie , Ying Wei , Wenbing Huang , Junzhou Huang

The development of large language models and multi-modal models has enabled the appealing idea of generating novel molecules from text descriptions. Generative modeling would shift the paradigm from relying on large-scale chemical screening…

Machine Learning · Computer Science 2025-08-25 Yifan Deng , Spencer S. Ericksen , Anthony Gitter

The research of metamaterials has achieved enormous success in the manipulation of light in an artificially prescribed manner using delicately designed sub-wavelength structures, so-called meta-atoms. Even though modern numerical methods…

Optics · Physics 2019-01-31 Wei Ma , Feng Cheng , Yihao Xu , Qinlong Wen , Yongmin Liu

Novel concepts are essential for design innovation and can be generated with the aid of data stimuli and computers. However, current generative design algorithms focus on diagrammatic or spatial concepts that are either too abstract to…

Computation and Language · Computer Science 2021-11-17 Qihao Zhu , Jianxi Luo

The aim of the inverse chemical design is to develop new molecules with given optimized molecular properties or objectives. Recently, generative deep learning (DL) networks are considered as the state-of-the-art in inverse chemical design…

Machine Learning · Computer Science 2019-10-10 Haoran Wei , Mariefel Olarte , Garrett B. Goh

As the amount of textual data has been rapidly increasing over the past decade, efficient similarity search methods have become a crucial component of large-scale information retrieval systems. A popular strategy is to represent original…

Information Retrieval · Computer Science 2017-08-14 Suthee Chaidaroon , Yi Fang

Designing composite materials as per the application requirements is fundamentally a challenging and time consuming task. Here we report the development of a deep neural network based computational framework capable of solving the forward…

Materials Science · Physics 2022-09-14 Ashank , Soumen Chakravarty , Pranshu Garg , Ankit Kumar , Manish Agrawal , Prabhat K. Agnihotri

In many domains generating variable length sequences through insertions provides greater flexibility over autoregressive models. However, the action space of insertion models is much larger than that of autoregressive models (ARMs) making…

Transcriptional profiling on microarrays to obtain gene expressions has been used to facilitate cancer diagnosis. We propose a deep generative machine learning architecture (called DeepCancer) that learn features from unlabeled microarray…

Artificial Intelligence · Computer Science 2016-12-14 Rajendra Rana Bhat , Vivek Viswanath , Xiaolin Li