English
Related papers

Related papers: ActPC-Chem: Discrete Active Predictive Coding for …

200 papers

A novel framework for designing the molecular structure of chemical compounds with a desired chemical property has recently been proposed. The framework infers a desired chemical graph by solving a mixed integer linear program (MILP) that…

Computational Engineering, Finance, and Science · Computer Science 2023-05-02 Jianshen Zhu , Naveed Ahmed Azam , Kazuya Haraguchi , Liang Zhao , Hiroshi Nagamochi , Tatsuya Akutsu

Language models are revolutionizing the biochemistry domain, assisting scientists in drug design and chemical synthesis with high efficiency. Yet current approaches struggle between small language models prone to hallucination and limited…

Machine Learning · Computer Science 2026-02-02 Hao Li , He Cao , Shenyao Peng , Zijing Liu , Bin Feng , Yu Wang , Zhiyuan Yan , Yonghong Tian , Yu Li , Li Yuan

Various automatic curriculum learning (ACL) methods have been proposed to improve the sample efficiency and final performance of deep reinforcement learning (DRL). They are designed to control how a DRL agent collects data, which is…

Machine Learning · Computer Science 2022-10-26 Jikun Kang , Miao Liu , Abhinav Gupta , Chris Pal , Xue Liu , Jie Fu

In this paper, we propose a neural-based coding scheme in which an artificial neural network is exploited to automatically compress and decompress speech signals by a trainable approach. Having a two-stage training phase, the system can be…

Sound · Computer Science 2016-01-25 Mahmood Yousefi-Azar , Farbod Razzazi

An introduction to the OpenCog Hyperon framework for Artificiai General Intelligence is presented. Hyperon is a new, mostly from-the-ground-up rewrite/redesign of the OpenCog AGI framework, based on similar conceptual and cognitive…

Backpropagation of error (backprop) is a powerful algorithm for training machine learning architectures through end-to-end differentiation. However, backprop is often criticised for lacking biological plausibility. Recently, it has been…

Machine Learning · Computer Science 2020-10-07 Beren Millidge , Alexander Tschantz , Christopher L. Buckley

Retrosynthesis analysis is pivotal yet challenging in drug discovery and organic chemistry. Despite the proliferation of computational tools over the past decade, AI-based systems often fall short in generalizing across diverse reaction…

Machine Learning · Computer Science 2024-08-21 Yifei Yang , Runhan Shi , Zuchao Li , Shu Jiang , Bao-Liang Lu , Yang Yang , Hai Zhao

Traditional drug discovery programs are being transformed by the advent of machine learning methods. Among these, Generative AI methods (GM) have gained attention due to their ability to design new molecules and enhance specific properties…

Current theoretical and computational models of dopamine-based reinforcement learning are largely rooted in the classical behaviorist tradition, and envision the organism as a purely reactive recipient of rewards and punishments, with…

Neurons and Cognition · Quantitative Biology 2014-05-01 Randall C. O'Reilly , Thomas E. Hazy , Jessica Mollick , Prescott Mackie , Seth Herd

Predictive coding networks are neuroscience-inspired models with roots in both Bayesian statistics and neuroscience. Training such models, however, is quite inefficient and unstable. In this work, we show how by simply changing the temporal…

Neural and Evolutionary Computing · Computer Science 2024-02-08 Tommaso Salvatori , Yuhang Song , Yordan Yordanov , Beren Millidge , Zhenghua Xu , Lei Sha , Cornelius Emde , Rafal Bogacz , Thomas Lukasiewicz

Agentic reinforcement learning trains large language models using multi-turn trajectories that interleave long reasoning traces with short environment-facing actions. Common policy-gradient methods, such as PPO and GRPO, treat each token in…

Machine Learning · Computer Science 2026-05-15 Langzhou He , Junyou Zhu , Yue Zhou , Zhengyao Gu , Junhua Liu , Wei-Chieh Huang , Henry Peng Zou , David Wipf , Philip S. Yu , Qitian Wu

Equipping agents with memory is essential for solving real-world long-horizon problems. However, most existing agent memory mechanisms rely on static and hand-crafted workflows. This limits the performance and generalization ability of…

Artificial Intelligence · Computer Science 2026-03-30 Yupeng Huo , Yaxi Lu , Zhong Zhang , Haotian Chen , Yankai Lin

Training with backpropagation (BP) in standard deep learning consists of two main steps: a forward pass that maps a data point to its prediction, and a backward pass that propagates the error of this prediction back through the network.…

Machine Learning · Computer Science 2022-10-13 Tommaso Salvatori , Luca Pinchetti , Beren Millidge , Yuhang Song , Tianyi Bao , Rafal Bogacz , Thomas Lukasiewicz

Predictive coding (PC) is an influential theory in computational neuroscience, which argues that the cortex forms unsupervised world models by implementing a hierarchical process of prediction error minimization. PC networks (PCNs) are…

Neural and Evolutionary Computing · Computer Science 2022-08-05 Beren Millidge , Yuhang Song , Tommaso Salvatori , Thomas Lukasiewicz , Rafal Bogacz

Large Language Model (LLM)-based agents exhibit systemic failures in compositional generalization, limiting their robustness in interactive environments. This work introduces AGEL-Comp, a neuro-symbolic AI agent architecture designed to…

Artificial Intelligence · Computer Science 2026-04-30 Mahnoor Shahid , Hannes Rothe

It is crucial to ask how agents can achieve goals by generating action plans using only partial models of the world acquired through habituated sensory-motor experiences. Although many existing robotics studies use a forward model…

Robotics · Computer Science 2020-06-01 Takazumi Matsumoto , Jun Tani

We propose Kernel Predictive Control (KPC), a learning-based predictive control strategy that enjoys deterministic guarantees of safety. Noise-corrupted samples of the unknown system dynamics are used to learn several models through the…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Emilio T. Maddalena , Paul Scharnhorst , Yuning Jiang , Colin N. Jones

Artificial intelligence is reshaping scientific discovery, yet its use in materials research remains limited by fragmented computational ecosystems, reproducibility challenges, and dependence on commercial large language models (LLMs). Here…

Artificial Intelligence · Computer Science 2025-12-16 Jaehyung Lee , Justin Ely , Kent Zhang , Akshaya Ajith , Charles Rhys Campbell , Kamal Choudhary

Despite advances in Reinforcement Learning, many sequential decision making tasks remain prohibitively expensive and impractical to learn. Recently, approaches that automatically generate reward functions from logical task specifications…

Artificial Intelligence · Computer Science 2023-04-12 Yash Shukla , Abhishek Kulkarni , Robert Wright , Alvaro Velasquez , Jivko Sinapov

Real-world artificial intelligence (AI) systems are increasingly required to operate autonomously in dynamic, uncertain, and continuously changing environments. However, most existing AI models rely on predefined objectives, static training…

Artificial Intelligence · Computer Science 2025-11-04 Hong Su