English
Related papers

Related papers: Retrosynthetic Planning with Dual Value Networks

200 papers

Molecular retrosynthesis is a significant and complex problem in the field of chemistry, however, traditional manual synthesis methods not only need well-trained experts but also are time-consuming. With the development of big data and…

Artificial Intelligence · Computer Science 2024-07-16 Yan Zhang , Hao Hao , Xiao He , Shuanhu Gao , Aimin Zhou

In this paper, the existing Scheduling Dimension Reduction (SDR) methods for Linear Parameter-Varying (LPV) models are reviewed and a Deep Neural Network (DNN) approach is developed that achieves higher model accuracy under scheduling…

Systems and Control · Electrical Eng. & Systems 2020-12-10 P. J. W. Koelewijn , R. Tóth

This paper proposes a novel deep reinforcement learning (RL) architecture, called Value Prediction Network (VPN), which integrates model-free and model-based RL methods into a single neural network. In contrast to typical model-based RL…

Artificial Intelligence · Computer Science 2017-11-08 Junhyuk Oh , Satinder Singh , Honglak Lee

Retrosynthesis planning is a fundamental challenge in chemistry which aims at designing reaction pathways from commercially available starting materials to a target molecule. Each step in multi-step retrosynthesis planning requires accurate…

Quantitative Methods · Quantitative Biology 2024-03-27 Ilia Igashov , Arne Schneuing , Marwin Segler , Michael Bronstein , Bruno Correia

Retrosynthesis planning, essential in organic synthesis and drug discovery, has greatly benefited from recent AI-driven advancements. Nevertheless, existing methods frequently face limitations in both applicability and explainability.…

Computational Engineering, Finance, and Science · Computer Science 2025-07-24 Situo Zhang , Hanqi Li , Lu Chen , Zihan Zhao , Xuanze Lin , Zichen Zhu , Bo Chen , Xin Chen , Kai Yu

Computer-assisted synthesis planning aims to help chemists find better reaction pathways faster. Finding viable and short pathways from sugar molecules to value-added chemicals can be modeled as a retrosynthesis planning problem with a…

Other Computer Science · Computer Science 2019-11-19 Peihong Jiang , Hieu Doan , Sandeep Madireddy , Rajeev Surendran Assary , Prasanna Balaprakash

We present an attention-based Transformer model for automatic retrosynthesis route planning. Our approach starts from reactants prediction of single-step organic reactions for given products, followed by Monte Carlo tree search-based…

Quantitative Methods · Quantitative Biology 2019-06-07 Kangjie Lin , Youjun Xu , Jianfeng Pei , Luhua Lai

We approach structured output prediction by optimizing a deep value network (DVN) to precisely estimate the task loss on different output configurations for a given input. Once the model is trained, we perform inference by gradient descent…

Machine Learning · Computer Science 2017-08-09 Michael Gygli , Mohammad Norouzi , Anelia Angelova

Retrosynthetic planning is a critical task in organic chemistry which identifies a series of reactions that can lead to the synthesis of a target product. The vast number of possible chemical transformations makes the size of the search…

Machine Learning · Computer Science 2020-06-30 Binghong Chen , Chengtao Li , Hanjun Dai , Le Song

This paper investigates a project with stochastic activity durations and cash flows under discrete scenarios, where activities must satisfy precedence constraints generating cash inflows and outflows. The objective is to maximize expected…

Machine Learning · Computer Science 2025-11-18 Wei Xu , Fan Yang , Qinyuan Cui , Zhi Chen

A promising way to improve the sample efficiency of reinforcement learning is model-based methods, in which many explorations and evaluations can happen in the learned models to save real-world samples. However, when the learned model has a…

Machine Learning · Computer Science 2022-09-14 Haoxin Lin , Yihao Sun , Jiaji Zhang , Yang Yu

Recent work [1] has utilized Moore-Penrose (MP) inverse in deep convolutional neural network (DCNN) learning, which achieves better generalization performance over the DCNN with a stochastic gradient descent (SGD) pipeline. However, Yang's…

Machine Learning · Computer Science 2021-01-06 Wandong Zhang , Yimin Yang , Jonathan Wu

Retrosynthesis -- the process of identifying a set of reactants to synthesize a target molecule -- is of vital importance to material design and drug discovery. Existing machine learning approaches based on language models and graph neural…

Chemical Physics · Physics 2021-12-10 Ruoxi Sun , Hanjun Dai , Li Li , Steven Kearnes , Bo Dai

Deep networks consume a large amount of memory by their nature. A natural question arises can we reduce that memory requirement whilst maintaining performance. In particular, in this work we address the problem of memory efficient learning…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Eunwoo Kim , Chanho Ahn , Philip H. S. Torr , Songhwai Oh

The goal of person search is to localize and match query persons from scene images. For high efficiency, one-step methods have been developed to jointly handle the pedestrian detection and identification sub-tasks using a single network.…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Chuchu Han , Zhedong Zheng , Changxin Gao , Nong Sang , Yi Yang

Value Iteration Networks (VINs) have emerged as a popular method to incorporate planning algorithms within deep reinforcement learning, enabling performance improvements on tasks requiring long-range reasoning and understanding of…

Machine Learning · Computer Science 2020-12-08 Andreea Deac , Petar Veličković , Ognjen Milinković , Pierre-Luc Bacon , Jian Tang , Mladen Nikolić

We introduce Dynamic Planning Networks (DPN), a novel architecture for deep reinforcement learning, that combines model-based and model-free aspects for online planning. Our architecture learns to dynamically construct plans using a learned…

Machine Learning · Computer Science 2019-02-05 Norman Tasfi , Miriam Capretz

Retrosynthesis strategically plans the synthesis of a chemical target compound from simpler, readily available precursor compounds. This process is critical for synthesizing novel inorganic materials, yet traditional methods in inorganic…

This paper explores the problem of simultaneously learning a value function and policy in deep actor-critic reinforcement learning models. We find that the common practice of learning these functions jointly is sub-optimal, due to an…

Machine Learning · Computer Science 2022-11-15 Matthew Aitchison , Penny Sweetser

Rising costs in recent years of developing new drugs and treatments have led to extensive research in optimization techniques in biomolecular design. Currently, the most widely used approach in biomolecular design is directed evolution,…

Machine Learning · Computer Science 2021-11-09 Alexander Whatley , Zhekun Luo , Xiangru Tang