and exactly how large of a download would be "download entire font library"? all that just to use one font? that's like downloading an entire JS library to use one thing from it if not worse.
If you're selfhosting you only need to have the fonts you actually intend to use, not the entire library. Having the entire library would only make sense for an extension that replaces Google Fonts requests with itself.