Questions in Robots.txt

details on how to use robots.txt properly