English
Related papers

Related papers: Energy-Based Models for Continual Learning

200 papers

By planning through a learned dynamics model, model-based reinforcement learning (MBRL) offers the prospect of good performance with little environment interaction. However, it is common in practice for the learned model to be inaccurate,…

Machine Learning · Computer Science 2021-03-31 Behzad Haghgoo , Allan Zhou , Archit Sharma , Chelsea Finn

While deep learning has resulted in major breakthroughs in many application domains, the frameworks commonly used in deep learning remain fragile to artificially-crafted and imperceptible changes in the data. In response to this fragility,…

Machine Learning · Computer Science 2020-11-03 Alexander Robey , Hamed Hassani , George J. Pappas

Model-based Reinforcement Learning (MBRL) holds promise for data-efficiency by planning with model-generated experience in addition to learning with experience from the environment. However, in complex or changing environments, models in…

Machine Learning · Computer Science 2022-05-24 Esra'a Saleh , John D. Martin , Anna Koop , Arash Pourzarabi , Michael Bowling

Learning distributions over graph-structured data is a challenging task with many applications in biology and chemistry. In this work we use an energy-based model (EBM) based on multi-channel graph neural networks (GNN) to learn permutation…

Machine Learning · Computer Science 2021-08-31 Shiv Shankar

This paper studies the fundamental problem of learning energy-based model (EBM) in the latent space of the generator model. Learning such prior model typically requires running costly Markov Chain Monte Carlo (MCMC). Instead, we propose to…

Machine Learning · Computer Science 2022-09-20 Zhisheng Xiao , Tian Han

This brief sketches initial progress towards a unified energy-based solution for the semi-supervised visual anomaly detection and localization problem. In this setup, we have access to only anomaly-free training data and want to detect and…

Machine Learning · Computer Science 2021-05-10 Ergin Utku Genc , Nilesh Ahuja , Ibrahima J Ndiour , Omesh Tickoo

Deep energy-based models are powerful, but pose challenges for learning and inference (Belanger and McCallum, 2016). Tu and Gimpel (2018) developed an efficient framework for energy-based models by training "inference networks" to…

Computation and Language · Computer Science 2020-10-13 Lifu Tu , Richard Yuanzhe Pang , Kevin Gimpel

Energy-based models (EBMs) estimate unnormalized densities in an elegant framework, but they are generally difficult to train. Recent work has linked EBMs to generative adversarial networks, by noting that they can be trained through a…

Machine Learning · Computer Science 2025-06-06 Cong Geng , Jia Wang , Li Chen , Zhiyong Gao , Jes Frellsen , Søren Hauberg

Humans are remarkably good at understanding and reasoning about complex visual scenes. The capability to decompose low-level observations into discrete objects allows us to build a grounded abstract representation and identify the…

Machine Learning · Computer Science 2022-10-12 Ruixiang Zhang , Tong Che , Boris Ivanovic , Renhao Wang , Marco Pavone , Yoshua Bengio , Liam Paull

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

Computation and Language · Computer Science 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

With the rapid progress of large language models (LLMs), reliably evaluating the capabilities of pre-trained LLMs has become increasingly important. The challenge is that base pre-trained models are optimized for next-token prediction and…

Computation and Language · Computer Science 2026-05-28 Shaobo Wang , Guo Chen , Ziyue Wang , Zhengyang Tang , Qingyang Liu , Xingzhang Ren , Dayiheng Liu , Linfeng Zhang

The vision community is undergoing the unprecedented progress with the emergence of Vision-Language Pretraining Models (VLMs). Prompt learning plays as the holy grail of accessing VLMs since it enables their fast adaptation to downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Ziliang Chen , Xin Huang , Quanlong Guan , Liang Lin , Weiqi Luo

Biases in machine learning pose significant challenges, particularly when models amplify disparities that affect disadvantaged groups. Traditional bias mitigation techniques often lead to a {\itshape leveling-down effect}, whereby improving…

Machine Learning · Computer Science 2025-09-03 Lucas Mansilla , Rodrigo Echeveste , Camila Gonzalez , Diego H. Milone , Enzo Ferrante

This paper introduces intermittent learning - the goal of which is to enable energy harvested computing platforms capable of executing certain classes of machine learning tasks effectively and efficiently. We identify unique challenges to…

Machine Learning · Computer Science 2019-12-17 Seulki Lee , Bashima Islam , Yubo Luo , Shahriar Nirjon

Learning continually from non-stationary data streams is a challenging research topic of growing popularity in the last few years. Being able to learn, adapt, and generalize continually in an efficient, effective, and scalable way is…

Machine Learning · Computer Science 2021-12-14 Antonio Carta , Andrea Cossu , Vincenzo Lomonaco , Davide Bacciu

Energy-based models (EBMs) implement inference as gradient descent on a learned Lyapunov function, yielding interpretable, structure-preserving alternatives to black-box neural ODEs and aligning naturally with physical AI. Yet their use in…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Simone Betteti , Luca Laurenti

In lifelong learning, the learner is presented with a sequence of tasks, incrementally building a data-driven prior which may be leveraged to speed up learning of a new task. In this work, we investigate the efficiency of current lifelong…

Machine Learning · Computer Science 2019-01-10 Arslan Chaudhry , Marc'Aurelio Ranzato , Marcus Rohrbach , Mohamed Elhoseiny

In pseudo-labeling (PL), which is a type of semi-supervised learning, pseudo-labels are assigned based on the confidence scores provided by the classifier; therefore, accurate confidence is important for successful PL. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Masahito Toba , Seiichi Uchida , Hideaki Hayashi

The discrepancy between maximum likelihood estimation (MLE) and task measures such as BLEU score has been studied before for autoregressive neural machine translation (NMT) and resulted in alternative training algorithms (Ranzato et al.,…

Computation and Language · Computer Science 2021-09-22 Sumanta Bhattacharyya , Amirmohammad Rooshenas , Subhajit Naskar , Simeng Sun , Mohit Iyyer , Andrew McCallum

Model-based reinforcement learning (MBRL) has shown its advantages in sample-efficiency over model-free reinforcement learning (MFRL). Despite the impressive results it achieves, it still faces a trade-off between the ease of data…

Machine Learning · Computer Science 2020-06-17 Xiaoyu Tan , Chao Qu , Junwu Xiong , James Zhang