English

Partial Answer of How Transformers Learn Automata

Formal Languages and Automata Theory 2025-05-13 v2 Machine Learning
Authors: Tiantian Zhang
View on arXiv ↗ PDF ↗

Abstract

We introduce a novel framework for simulating finite automata using representation-theoretic semidirect products and Fourier modules, achieving more efficient Transformer-based implementations.

Keywords

automata theory

Cite

@article{arxiv.2504.20395,
  title  = {Partial Answer of How Transformers Learn Automata},
  author = {Tiantian Zhang},
  journal= {arXiv preprint arXiv:2504.20395},
  year   = {2025}
}

Related papers

View all related →
Machine Learning · Computer Science
Learning a Driving Simulator
Eder Santana, George Hotz
2016-08-04
Robotics · Computer Science
Learning to falsify automated driving vehicles with prior knowledge
Andrea Favrin, Vladislav Nenchev, Angelo Cenedese
2021-01-27
Machine Learning · Computer Science
Transformers Learn Shortcuts to Automata
Bingbin Liu, Jordan T. Ash, Surbhi Goel, Akshay Krishnamurthy +1
2023-05-03
Robotics · Computer Science
Reinforcement learning for non-prehensile manipulation: Transfer from simulation to physical system
Kendall Lowrey, Svetoslav Kolev, Jeremy Dao, Aravind Rajeswaran +1
2018-03-29
Machine Learning · Computer Science
Modular meta-learning
Ferran Alet, Tomás Lozano-Pérez, Leslie P. Kaelbling
2019-05-06
Machine Learning · Computer Science
Learning To Simulate
Nataniel Ruiz, Samuel Schulter, Manmohan Chandraker
2019-05-15
Computation and Language · Computer Science
Simulating Weighted Automata over Sequences and Trees with Transformers
Michael Rizvi, Maude Lizaire, Clara Lacroce, Guillaume Rabusseau
2024-03-18
Formal Languages and Automata Theory · Computer Science
Simulations of Weighted Tree Automata
Zoltán Ésik, Andreas Maletti
2015-05-18
Formal Languages and Automata Theory · Computer Science
On the Structure Theory of Partial Automaton Semigroups
Daniele D'Angeli, Emanuele Rodaro, Jan Philipp Wächter
2020-07-17
Machine Learning · Computer Science
FlexFringe: Modeling Software Behavior by Learning Probabilistic Automata
Sicco Verwer, Christian Hammerschmidt
2025-10-01
Machine Learning · Computer Science
Symbolic Feedforward Networks for Probabilistic Finite Automata: Exact Simulation and Learnability
Sahil Rajesh Dhayalkar
2025-09-24
Robotics · Computer Science
Trajectory Prediction for Autonomous Driving Using a Transformer Network
Zhenning Li, Hao Yu
2024-02-27
Machine Learning · Computer Science
Transfer Learning Study of Motion Transformer-based Trajectory Predictions
Lars Ullrich, Alex McMaster, Knut Graichen
2024-08-08
Machine Learning · Computer Science
Transformer-Powered Surrogates Close the ICF Simulation-Experiment Gap with Extremely Limited Data
Matthew L. Olson, Shusen Liu, Jayaraman J. Thiagarajan, Bogdan Kustowski +2
2024-05-29
Statistics Theory · Mathematics
Semi-parametric estimation of shifts
Fabrice Gamboa, Jean-Michel Loubes, Elie Maza
2007-12-18
Robotics · Computer Science
A Versatile and Efficient Reinforcement Learning Framework for Autonomous Driving
Guan Wang, Haoyi Niu, Desheng Zhu, Jianming Hu +2
2022-03-04
Neural and Evolutionary Computing · Computer Science
Employing Discrete Fourier Transform in Representational Learning
Raoof HojatJalali, Edmondo Trentin
2025-06-10
Machine Learning · Computer Science
General Transform: A Unified Framework for Adaptive Transform to Enhance Representations
Gekko Budiutama, Shunsuke Daimon, Hirofumi Nishi, Yu-ichiro Matsushita
2025-05-09
Machine Learning · Computer Science
An Introduction to Transformers
Richard E. Turner
2026-01-21
Machine Learning · Computer Science
Transformers for One-Shot Visual Imitation
Sudeep Dasari, Abhinav Gupta
2020-11-12
Machine Learning · Computer Science
Transformers Meet Relational Databases
Jakub Peleška, Gustav Šír
2025-07-24
Quantum Physics · Physics
Learning Quantum Finite Automata with Queries
Daowen Qiu
2023-11-14
Robotics · Computer Science
Perception Imitation: Towards Synthesis-free Simulator for Autonomous Vehicles
Xiaoliang Ju, Yiyang Sun, Yiming Hao, Yikang Li +2
2023-04-20
Group Theory · Mathematics
Fast Fourier Transforms for Finite Inverse Semigroups
Martin Malandro
2011-08-02
Robotics · Computer Science
Sim2Real Diffusion: Leveraging Foundation Vision Language Models for Adaptive Automated Driving
Chinmay Vilas Samak, Tanmay Vilas Samak, Bing Li, Venkat Krovi
2025-11-21
R2 v1 2026-06-28T23:14:43.645Z