>>3
> [Firefox] will GET /favicon.ico without being told there is one.
Download managers and spiders will look for robots.txt, isn't it similar to that?