> in the distribution world (Debian, etc) that takes great care about license compliance, patching upstreams to include copyright notices in binaries isn't a thing

On Debian, you will find the llama.cpp copyright notice in /usr/share/doc/llama.cpp/copyright if you have installed the llama.cpp binary package.