People have actually gotten into trouble for accessing subdirectories which aren't accessible via links from the site's index page. But I'm not sure if that extends to robots.txt, at least as it pertains to stuff which is intended for public consumption. Otherwise people who host sites containing illegal content would just put the entire site in robots.txt.