Foundational language models show a remarkable ability to learn new concepts during inference via context data. However, similar work for images lag behind. To address this challenge, we introduce FLoWN, a flow matching model that learns to generate neural network parameters for different tasks. Our approach models the flow on latent space, while conditioning the process on context data. Experiments verify that FLoWN attains various desiderata for a meta-learning model. In addition, it matches or exceeds baselines on in-distribution tasks, provides better initializations for classifier training, and is performant on out-of-distribution few-shot tasks while having a fine-tuning mechanism to improve performance.
@article{arxiv.2503.19371,
title = {Flow to Learn: Flow Matching on Neural Network Parameters},
author = {Daniel Saragih and Deyu Cao and Tejas Balaji and Ashwin Santhosh},
journal= {arXiv preprint arXiv:2503.19371},
year = {2025}
}
Comments
Accepted at the ICLR Workshop on Neural Network Weights as a New Data Modality 2025