It's "just" a business district within London, leaving aside a couple of millennia of history. London comprises the City and 32 boroughs, somewhat similarly to the way New York is made up of five boroughs, one of which is also called "New York" in some contexts.