We present TritorX, an agentic AI system designed to generate functionally correct Triton PyTorch ATen kernels at scale for emerging accelerator platforms. TritorX integrates open-source large language models with a custom linter, JIT compilation, and a PyTorch OpInfo-based test harness. This pipeline is compatible with both real Meta Training and Inference Accelerator (MTIA) silicon and in hardware simulation environments for next-generation devices. In contrast to previous kernel-generation approaches that prioritize performance for a limited set of high-usage kernels, TritorX prioritizes coverage. Our system emphasizes correctness and generality across the entire operator set, including diverse data types, shapes, and argument patterns. In our experiments, TritorX successfully generated kernels and wrappers for 481 unique ATen operators that pass all corresponding PyTorch OpInfo tests (over 20,000 in total). TritorX paves the way for overnight generation of complete PyTorch ATen backends for new accelerator platforms.
Cite
@article{arxiv.2512.10977,
title = {Agentic Operator Generation for ML ASICs},
author = {Alec M. Hammond and Aram Markosyan and Aman Dontula and Simon Mahns and Zacharias Fisches and Dmitrii Pedchenko and Keyur Muzumdar and Natacha Supper and Mark Saroufim and Joe Isaacson and Laura Wang and Warren Hunt and Kaustubh Gondkar and Roman Levenstein and Gabriel Synnaeve and Richard Li and Jacob Kahn and Ajit Mathews},
journal= {arXiv preprint arXiv:2512.10977},
year = {2025}
}