English
Related papers

Related papers: Predictive Learning in Energy-based Models with At…

200 papers

Deep learning based approaches have achieved significant progresses in different tasks like classification, detection, segmentation, and so on. Ensemble learning is widely known to further improve performance by combining multiple…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Danlu Chen , Xu-Yao Zhang , Wei Zhang , Yao Lu , Xiuli Li , Tao Mei

Generative Pre-trained Transformer (GPT) architectures are the most popular design for language modeling. Energy-based modeling is a different paradigm that views inference as a dynamical process operating on an energy landscape. We propose…

Machine Learning · Computer Science 2026-05-04 Nima Dehmamy , Benjamin Hoover , Bishwajit Saha , Leo Kozachkov , Jean-Jacques Slotine , Dmitry Krotov

Despite deep-learning being state-of-the-art for data-driven model predictions, it has not yet found frequent application in ecology. Given the low sample size typical in many environmental research fields, the default choice for the…

Applications · Statistics 2022-09-29 Marieke Wesselkamp , Niklas Moser , Maria Kalweit , Joschka Boedecker , Carsten F. Dormann

We consider learning from labeled data collected across multiple environments, where the data distribution may vary across these environments. This problem is commonly approached from a causal perspective, seeking invariant representations…

Machine Learning · Statistics 2026-04-30 Yuli Slavutsky , David M. Blei

This work uses game theory as a mathematical framework to address interaction modeling in multi-agent motion forecasting and control. Despite its interpretability, applying game theory to real-world robotics, like automated driving, faces…

Machine Learning · Computer Science 2023-12-05 Christopher Diehl , Tobias Klosek , Martin Krüger , Nils Murzyn , Timo Osterburg , Torsten Bertram

This study suggests a new prediction model for chaotic time series inspired by the brain emotional learning of mammals. We describe the structure and function of this model, which is referred to as BELPM (Brain Emotional Learning-Based…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Mahboobeh Parsapoor

Reinforcement learning has been successfully used to solve difficult tasks in complex unknown environments. However, these methods typically do not provide any safety guarantees during the learning process. This is particularly problematic,…

Systems and Control · Electrical Eng. & Systems 2019-07-02 Torsten Koller , Felix Berkenkamp , Matteo Turchetta , Joschka Boedecker , Andreas Krause

Classical Bayesian persuasion assumes that senders fully understand how receivers form beliefs and make decisions--an assumption that rarely holds when receivers possess private information or exhibit non-Bayesian behavior. In this paper,…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Heeseung Bang , Andreas A. Malikopoulos

Energy-based language models (ELMs) parameterize an unnormalized distribution for natural sentences and are radically different from popular autoregressive language models (ALMs). As an important application, ELMs have been successfully…

Computation and Language · Computer Science 2023-05-30 Hong Liu , Zhaobiao Lv , Zhijian Ou , Wenbo Zhao , Qing Xiao

This study presents a dynamic neural network model based on the predictive coding framework for perceiving and predicting the dynamic visuo-proprioceptive patterns. In our previous study [1], we have shown that the deep dynamic neural…

Artificial Intelligence · Computer Science 2017-06-09 Jungsik Hwang , Jinhyung Kim , Ahmadreza Ahmadi , Minkyu Choi , Jun Tani

The exploration of whether agents can align with their environment without relying on human-labeled data presents an intriguing research topic. Drawing inspiration from the alignment process observed in intelligent organisms, where…

Computation and Language · Computer Science 2024-03-06 Bo Wang , Tianxiang Sun , Hang Yan , Siyin Wang , Qingyuan Cheng , Xipeng Qiu

We address the problem of building theoretical models that help elucidate the function of the visual brain at computational/algorithmic and structural/mechanistic levels. We seek to understand how the receptive fields and topographic maps…

Neural and Evolutionary Computing · Computer Science 2020-11-10 Simon Osindero

A long-standing challenge in Reinforcement Learning is enabling agents to learn a model of their environment which can be transferred to solve other problems in a world with the same underlying rules. One reason this is difficult is the…

Machine Learning · Computer Science 2019-05-16 Kai Olav Ellefsen , Jim Torresen

The ability to accurately predict the surrounding environment is a foundational principle of intelligence in biological and artificial agents. In recent years, a variety of approaches have been proposed for learning to predict the physical…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Alberto Cenzato , Alberto Testolin , Marco Zorzi

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most existing LLM-based…

Robotics · Computer Science 2026-04-21 Xiaoyu Ma , Lianyu Hu , Wenbing Tang , Zixuan Hu , Zeqin Liao , Zhizhen Wu , Yang Liu

We find that across a wide range of robot policy learning scenarios, treating supervised policy learning with an implicit model generally performs better, on average, than commonly used explicit models. We present extensive experiments on…

Mobile robots rely on maps to navigate through an environment. In the absence of any map, the robots must build the map online from partial observations as they move in the environment. Traditional methods build a map using only direct…

Robotics · Computer Science 2024-10-14 Vishnu Dutt Sharma

Deep convolutional neural networks achieve remarkable performance by exhaustively processing dense spatial feature maps, yet this brute-force strategy introduces significant computational redundancy and encourages reliance on spurious…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Tom Devynck , Bilal Faye , Djamel Bouchaffra , Nadjib Lazaar , Hanane Azzag , Mustapha Lebbah

We consider apprenticeship learning, i.e., having an agent learn a task by observing an expert demonstrating the task in a partially observable environment when the model of the environment is uncertain. This setting is useful in…

Machine Learning · Computer Science 2012-07-03 Takaki Makino , Johane Takeuchi

Deep learning approaches such as convolutional neural nets have consistently outperformed previous methods on challenging tasks such as dense, semantic segmentation. However, the various proposed networks perform differently, with behaviour…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Konstantinos Kamnitsas , Wenjia Bai , Enzo Ferrante , Steven McDonagh , Matthew Sinclair , Nick Pawlowski , Martin Rajchl , Matthew Lee , Bernhard Kainz , Daniel Rueckert , Ben Glocker