English
Related papers

Related papers: Understanding Sample Efficiency in Predictive Codi…

200 papers

In continual learning (CL), the goal is to design models that can learn a sequence of tasks without catastrophic forgetting. While there is a rich set of techniques for CL, relatively little understanding exists on how representations built…

Machine Learning · Computer Science 2022-11-08 Yingcong Li , Mingchen Li , M. Salman Asif , Samet Oymak

A key motivation in the development of Distributed Model Predictive Control (DMPC) is to accelerate centralized Model Predictive Control (MPC) for large-scale systems. DMPC has the prospect of scaling well by parallelizing computations…

Optimization and Control · Mathematics 2025-04-16 Gösta Stomberg , Maurice Raetsch , Alexander Engelmann , Timm Faulwasser

Predictive coding networks (PCNs) constitute a biologically inspired framework for understanding hierarchical computation in the brain, and offer an alternative to traditional feedforward neural networks in ML. This note serves as a quick,…

Neural and Evolutionary Computing · Computer Science 2025-06-10 Mikko Stenlund

Predictive coding (PDC) has recently attracted attention in the neuroscience and computing community as a candidate unifying paradigm for neuronal studies and artificial neural network implementations particularly targeted at unsupervised…

Artificial Intelligence · Computer Science 2017-01-04 Emmanuel Ndidi Osegi , Vincent Ike Anireh

Lateral predictive coding (LPC) is a simple theoretical framework to appreciate feature detection in biological neural circuits. Recent theoretical work [Huang et al., Phys.Rev.E 112, 034304 (2025)] has successfully constructed optimal LPC…

Neurons and Cognition · Quantitative Biology 2026-04-23 Guanghui Cai , Zhen-Ye Huang , Weikang Wang , Hai-Jun Zhou

Data-Enabled Predictive Control (DeePC) bypasses the need for system identification by directly leveraging raw data to formulate optimal control policies. However, the size of the optimization problem in DeePC grows linearly with respect to…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Yihan Zhou , Yiwen Lu , Zishuo Li , Jiaqi Yan , Yilin Mo

Convolutional neural networks (CNNs) have achieved state-of-the-art performance on various tasks in computer vision. However, recent studies demonstrate that these models are vulnerable to carefully crafted adversarial samples and suffer…

Machine Learning · Computer Science 2020-12-15 Xin Li , Xiangrui Li , Deng Pan , Dongxiao Zhu

Dense prediction tasks such as segmentation and detection of pathological entities hold crucial clinical value in computational pathology workflows. However, obtaining dense annotations on large cohorts is usually tedious and expensive.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Jingwei Zhang , Saarthak Kapse , Ke Ma , Prateek Prasanna , Maria Vakalopoulou , Joel Saltz , Dimitris Samaras

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-05-28 Jiaxing Wang , Yin Zheng , Xiaoshuang Chen , Junzhou Huang , Jian Cheng

The superior performance of some of today's state-of-the-art deep learning models is to some extent owed to extensive (self-)supervised contrastive pretraining on large-scale datasets. In contrastive learning, the network is presented with…

Machine Learning · Computer Science 2022-07-20 Shervin Ardeshir , Navid Azizan

Reinforcement Learning (RL) has demonstrated a huge potential in learning optimal policies without any prior knowledge of the process to be controlled. Model Predictive Control (MPC) is a popular control technique which is able to deal with…

Systems and Control · Computer Science 2019-04-10 Mario Zanon , Sébastien Gros , Alberto Bemporad

Today, scene graph generation(SGG) task is largely limited in realistic scenarios, mainly due to the extremely long-tailed bias of predicate annotation distribution. Thus, tackling the class imbalance trouble of SGG is critical and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Shaotian Yan , Chen Shen , Zhongming Jin , Jianqiang Huang , Rongxin Jiang , Yaowu Chen , Xian-Sheng Hua

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

Machine Learning · Computer Science 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Branch predictor (BP) is an essential component in modern processors since high BP accuracy can improve performance and reduce energy by decreasing the number of instructions executed on wrong-path. However, reducing latency and storage…

Hardware Architecture · Computer Science 2018-04-03 Sparsh Mittal

Instructors have limited time and resources to help struggling students, and these resources should be directed to the students who most need them. To address this, researchers have constructed models that can predict students' final course…

Machine Learning · Computer Science 2021-02-12 Ge Gao , Samiha Marwan , Thomas W. Price

Recent work has shown a variety of ways in which machine learning can be used to accelerate the solution of constrained optimization problems. Increasing demand for real-time decision-making capabilities in applications such as artificial…

Machine Learning · Computer Science 2024-04-02 Ethan King , James Kotary , Ferdinando Fioretto , Jan Drgona

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

Machine Learning · Computer Science 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

We present PredProp, a method for optimization of weights and states in predictive coding networks (PCNs) based on the precision of propagated errors and neural activity. PredProp jointly addresses inference and learning via stochastic…

Machine Learning · Computer Science 2023-05-08 André Ofner , Sebastian Stober

There is a growing body of research indicating the potential of machine learning to tackle complex software testing challenges. One such challenge pertains to continuous integration testing, which is highly time-constrained, and generates a…

Software Engineering · Computer Science 2022-04-26 Dusica Marijan

Conformal prediction (CP) is a wrapper around traditional machine learning models, giving coverage guarantees under the sole assumption of exchangeability; in classification problems, for a chosen significance level $\varepsilon$, CP…

Machine Learning · Computer Science 2023-02-23 Javier Abad , Umang Bhatt , Adrian Weller , Giovanni Cherubin