We study spaces of conformal blocks associated with line bundles over elliptic curves, with coefficients in a vertex algebra. For vertex algebras satisfying suitable finiteness and semisimplicity conditions, which are met by all admissible affine vertex algebras as well as admissible W-algebras associated with nilpotent elements of standard Levi type, we prove the holonomicity of the sheaf of conformal blocks over the moduli space of bundles. Furthermore, we show that the space of flat sections of the associated Jacobi-invariant connection is spanned by trace functions on modules. This result provides a substantial generalization of the celebrated theorem of Yongchang Zhu to quasi-lisse vertex algebras. As a special case, we deduce that for affine vertex algebras at admissible level, the dimension of the space of conformal blocks coincides with the number of admissible weights at that level.