Getting aligned on representational alignment
Abstract
Biological and artificial information processing systems form representations of the world that they can use to categorize, reason, plan, navigate, and make decisions. How can we measure the similarity between the representations formed by these diverse systems? Do similarities in representations then translate into similar behavior? If so, then how can a system's representations be modified to better match those of another system? These questions pertaining to the study of representational alignment are at the heart of some of the most promising research areas in contemporary cognitive science, neuroscience, and machine learning. In this Perspective, we survey the exciting recent developments in representational alignment research in the fields of cognitive science, neuroscience, and machine learning. Despite their overlapping interests, there is limited knowledge transfer between these fields, so work in one field ends up duplicated in another, and useful innovations are not shared effectively. To improve communication, we propose a unifying framework that can serve as a common language for research on representational alignment, and map several streams of existing work across fields within our framework. We also lay out open problems in representational alignment where progress can benefit all three of these fields. We hope that this paper will catalyze cross-disciplinary collaboration and accelerate progress for all communities studying and developing information processing systems.
Keywords
Cite
@article{arxiv.2310.13018,
title = {Getting aligned on representational alignment},
author = {Ilia Sucholutsky and Lukas Muttenthaler and Adrian Weller and Andi Peng and Andreea Bobu and Been Kim and Bradley C. Love and Christopher J. Cueva and Erin Grant and Iris Groen and Jascha Achterberg and Joshua B. Tenenbaum and Katherine M. Collins and Katherine L. Hermann and Kerem Oktar and Klaus Greff and Martin N. Hebart and Nathan Cloos and Nikolaus Kriegeskorte and Nori Jacoby and Qiuyi Zhang and Raja Marjieh and Robert Geirhos and Sherol Chen and Simon Kornblith and Sunayana Rane and Talia Konkle and Thomas P. O'Connell and Thomas Unterthiner and Andrew K. Lampinen and Klaus-Robert Müller and Mariya Toneva and Thomas L. Griffiths},
journal= {arXiv preprint arXiv:2310.13018},
year = {2024}
}
Comments
51 pages; Working paper (changes to be made in upcoming revisions)