Modular invariance on $S^1 \times S^3$ and circle fibrations

I conjecture a high-temperature/low-temperature duality for conformal field theories defined on circle fibrations like $S^3$ and its lens space family. The duality is an exchange between the thermal circle and the fiber circle in the limit where both are small. The conjecture is motivated by the fact that $\pi_1(S^3/\mathbb{Z}_{p\rightarrow \infty})=\mathbb{Z}=\pi_1(S^1\times S^2)$ and the Gromov-Hausdorff distance between $S^3/\mathbb{Z}_{p\rightarrow \infty}$ and $S^1/\mathbb{Z}_{p\rightarrow \infty} \times S^2$ vanishes. Several checks of the conjecture are provided: free fields, $\mathcal{N}=1$ theories in four dimensions (which shows that the Di Pietro-Komargodski supersymmetric Cardy formula and its generalizations are given exactly by a supersymmetric Casimir energy), $\mathcal{N}=4$ super Yang-Mills at strong coupling, and the six-dimensional $\mathcal{N}=(2,0)$ theory. For all examples considered, the duality is powerful enough to control the high-temperature asymptotics on the unlensed $S^3$, relating it to the Casimir energy on a highly lensed $S^3$.