There goes a little practical hint on how to control how the webcrawlers (robots, spiders) out...