I feel like physics is tending in the opposite direction: God made the complex numbers as an algebraically closed field, and provided a few groups to operate on. The rest we made up -- including the integers.