English

Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning

Machine Learning 2026-05-20 v1 Artificial Intelligence

Abstract

We propose Adaptive Multi-Scale Goodness Aggregation (AMSGA), a novel extension of the Forward-Forward (FF) algorithm designed to improve stability, robustness, and generalization in local-learning neural networks. AMSGA addresses several limitations of the original FF framework by introducing multi-scale goodness aggregation across local, intermediate, and global representations; adaptive curriculum-guided hard negative mining; layer-dependent adaptive thresholds; and a warm-up cosine annealing learning-rate schedule for improved optimization stability. Together, these modifications strengthen the FF paradigm while preserving its biologically plausible and memory-efficient properties. Experiments on MNIST and Fashion-MNIST demonstrate consistent performance improvements over the baseline FF algorithm, achieving up to +1.45% improvement on MNIST and +1.50% improvement on Fashion-MNIST without significant computational overhead. Our results suggest that local learning methods can become substantially more competitive when goodness estimation and training dynamics are carefully designed.

Keywords

Cite

@article{arxiv.2605.18804,
  title  = {Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning},
  author = {Salar Beigzad and Vansh Verma},
  journal= {arXiv preprint arXiv:2605.18804},
  year   = {2026}
}

Comments

6 pages, 5 tables, IEEE format