Evidence has mounted that Type Ia and core-collapse (CC) supernovae (SNe) can have substantial deviations from spherical symmetry; one such piece of evidence is the complex morphologies of supernova remnants (SNRs). However, the relative role of the explosion geometry and the environment in shaping SNRs remains an outstanding question. Recently, we have developed techniques to quantify the morphologies of SNRs, and we have applied these methods to the extensive X-ray and infrared archival images available of Milky Way and Magellanic Cloud SNRs. In this proceeding, we highlight some results from these studies, with particular emphasis on SNR asymmetries and whether they arise from "nature" versus "nurture".