User-agent: Wget Disallow: / User-agent: CURL Disallow: / User-agent: * Disallow: /datastore/ Disallow: /pictures/not/found Disallow: /pictures/random/ Disallow: /my/ Disallow: /xyzzy/ Disallow: /ratemy/ Disallow: /cgi-bin/