The short answer to your question: liability. In an age where anti-discrimination laws give people ample ammunition to sue for not being hired, it's financially prudent for companies to be rude.

And yes, I too find it frustrating, given that I'm currently looking for a job as well.