#Web crawler file#

User-agent: *
Disallow: