English
Related papers

Related papers: Habitual and Reflective Control in Hierarchical Pr…

200 papers

Behavior trees represent a hierarchical and modular way of combining several low-level control policies into a high-level task-switching policy. Hybrid dynamical systems can also be seen in terms of task switching between different…

Systems and Control · Electrical Eng. & Systems 2021-11-11 Christopher Iliffe Sprague , Petter Ögren

Hierarchical DQN (h-DQN) is a two-level architecture of feedforward neural networks where the meta level selects goals and the lower level takes actions to achieve the goals. We show tasks that cannot be solved by h-DQN, exemplifying the…

Artificial Intelligence · Computer Science 2020-06-23 Weihang Yuan , Héctor Muñoz-Avila

In many scenarios, human decisions are explained based on some high-level concepts. In this work, we take a step in the interpretability of neural networks by examining their internal representation or neuron's activations against concepts.…

Machine Learning · Computer Science 2021-11-09 Mohammad Nokhbeh Zaeem , Majid Komeili

Lateral predictive coding (LPC) is a simple theoretical framework to appreciate feature detection in biological neural circuits. Recent theoretical work [Huang et al., Phys.Rev.E 112, 034304 (2025)] has successfully constructed optimal LPC…

Neurons and Cognition · Quantitative Biology 2026-04-23 Guanghui Cai , Zhen-Ye Huang , Weikang Wang , Hai-Jun Zhou

Many tasks require flexibly modifying perception and behavior based on current goals. Humans can retrieve episodic memories from days to years ago, using them to contextualize and generalize behaviors across novel but structurally related…

Neural and Evolutionary Computing · Computer Science 2025-12-22 Yicong Zheng , Nora Wolf , Charan Ranganath , Randall C. O'Reilly , Kevin L. McKee

The optimal control of a water reservoir systems represents a challenging problem, due to uncertain hydrologic inputs and the need to adapt to changing environment and varying control objectives. In this work, we propose a real-time…

Systems and Control · Electrical Eng. & Systems 2021-03-26 Pauline Kergus , Simone Formentin , Matteo Giuliani , Andrea Castelletti

Feature extraction is crucial for human activity recognition (HAR) using body-worn movement sensors. Recently, learned representations have been used successfully, offering promising alternatives to manually engineered features. Our work…

Machine Learning · Computer Science 2020-12-11 Harish Haresamudram , Irfan Essa , Thomas Ploetz

This paper describes a hierarchical control scheme for interconnected systems. The higher layer of the control structure is designed with robust Model Predictive Control (MPC) based on a reduced order dynamic model of the overall system and…

Systems and Control · Computer Science 2017-03-09 Marcello Farina , Xinglong Zhang , Riccardo Scattolini

For robotic vehicles to navigate robustly and safely in unseen environments, it is crucial to decide the most suitable navigation policy. However, most existing deep reinforcement learning based navigation policies are trained with a…

Robotics · Computer Science 2023-10-31 Kyowoon Lee , Seongun Kim , Jaesik Choi

We consider the question: when a large language reasoning model makes a choice, did it think first and then decide to, or decide first and then think? In this paper, we present evidence that detectable, early-encoded decisions shape…

Artificial Intelligence · Computer Science 2026-04-06 Esakkivel Esakkiraja , Sai Rajeswar , Denis Akhiyarov , Rajagopal Venkatesaramani

Neural networks with equal excitatory and inhibitory feedback show high computational performance. They operate close to a critical point characterized by the joint activation of large populations of neurons. Yet, in macaque motor cortex we…

Disordered Systems and Neural Networks · Physics 2019-08-13 David Dahmen , Sonja Grün , Markus Diesmann , Moritz Helias

Large Reasoning Models (LRMs) often suffer from computational inefficiency due to overthinking, where a fixed reasoning budget fails to match the varying complexity of tasks. To address this issue, we propose Adaptive Overclocking, a method…

Machine Learning · Computer Science 2025-09-23 Shuhao Jiang , Songbo Wang , Yang Qiao , Chun Xu , Chaoyang Zheng , Shengyi Zhou , Huanjun Wang , Fangming Li , Cong Zhang , Jiyu Wang

In control applications there is often a compromise that needs to be made with regards to the complexity and performance of the controller and the computational resources that are available. For instance, the typical hardware platform in…

Systems and Control · Electrical Eng. & Systems 2020-11-30 Eivind Bøhn , Sebastien Gros , Signe Moe , Tor Arne Johansen

Artificial intelligence (AI) is rapidly becoming one of the key technologies of this century. The majority of results in AI thus far have been achieved using deep neural networks trained with a learning algorithm called error…

Artificial Intelligence · Computer Science 2025-10-30 Tommaso Salvatori , Ankur Mali , Christopher L. Buckley , Thomas Lukasiewicz , Rajesh P. N. Rao , Karl Friston , Alexander Ororbia

Conformal prediction has emerged as a widely used framework for constructing valid prediction sets in classification and regression tasks. In this work, we extend the split conformal prediction framework to hierarchical classification,…

Machine Learning · Statistics 2026-04-13 Thomas Mortier , Alireza Javanmardi , Yusuf Sale , Eyke Hüllermeier , Willem Waegeman

Humans perform exquisite sensorimotor skills, both individually and in teams, from athletes performing rhythmic gymnastics to everyday tasks like carrying a cup of coffee. The "predictive brain" framework suggests that mastering these…

Neurons and Cognition · Quantitative Biology 2025-03-10 Marta Russo , Antonella Maselli , Dagmar Sternad , Giovanni Pezzulo

The predictive processing (PP) hypothesizes that the predictive inference of our sensorimotor system is encoded implicitly in the regularities between perception and action. We propose a neural architecture in which such regularities of…

Robotics · Computer Science 2018-04-12 Junpei Zhong , Angelo Cangelosi , Xinzheng Zhang , Tetsuya Ogata

Concurrent pattern calculus (CPC) drives interaction between processes by comparing data structures, just as sequential pattern calculus drives computation. By generalising from pattern matching to pattern unification, interaction becomes…

Logic in Computer Science · Computer Science 2015-07-01 Thomas Given-Wilson , Daniele Gorla , Barry Jay

A two-layer control architecture is proposed to enable scalable implementations for constraint-based decision strategies, such as model predictive controllers. The bottom layer is based upon a distributed feedback-feedforward scheme that…

Systems and Control · Electrical Eng. & Systems 2026-04-13 Andrei Sperilă , Alessio Iovine , Sorin Olaru , Patrick Panciatici

The backpropagation of error algorithm used to train deep neural networks has been fundamental to the successes of deep learning. However, it requires sequential backward updates and non-local computations, which make it challenging to…

Neural and Evolutionary Computing · Computer Science 2022-02-22 Beren Millidge , Tommaso Salvatori , Yuhang Song , Rafal Bogacz , Thomas Lukasiewicz