Geobot

What is Geobot?

Geobot is a robot which crawls websites within the UK namespace (.uk), or websites where it has some reason other than the domain name to think that that website is a UK website.

Geobot is building an index which will eventually be publically searchable.

If you would like to be emailed when this index goes live, and with other news about Geobot, please fill in your email address below:

Contact Geobot

Geobot is operated by Dan. Contact Dan with any questions or problems relating to Geobot or its behaviour:
dan@geobot.co.uk

robots.txt and the robots meta tag

Use robots.txt to control which pages Geobot retrieves from your server.

Geobot does not currently understand the robots meta tag - if this is causing you problems please contact Dan:
dan@geobot.co.uk

For further information about robots.txt see:
http://www.robotstxt.org/wc/norobots.html

For further information about the robots meta tag see:
http://www.robotstxt.org/wc/meta-user.html

Frequency

Geobot should not make more than one request to your server per minute.

Geobot wants to be good

Geobot wants to be a good robot.

If Geobot is causing you problems, or if you think it could be operated better, or if there is anything else you think should be on this page, please let Dan know:
dan@geobot.co.uk