O/T Google(Bot) & Yahoo(Bot)

[Weetabix Kid]

Seem to be regurlar users on here, is this were they get all their news stories from?

[Posh]

Often called a search engine robot or search engine spider they crawl a website looking for new content and to index the website so information on the Google search engine is accurate. Google works on a load of algorithims and other complex mathematics. In essence though a robot will visit a site on a pre-determined basis, if the content changes frequently (e.g. Morecambe FC site) it will visit several times a day. If content doesn't change then it maybe once a month or more. It seems they are on here all the time.

The search engines all have their own crawlers plus a lot of directory sites. A busy site like BBC can be crawled millions of times a day by hundreds of crawlers.

Having said all that because Keith hasn't transferred over the domain properly the site isn't indexing properly (http://www.google.co.uk/search?hl=en&q= ... o.uk&meta=) and instead are now being found on ttpics.co.uk.

To find out what Google has read click the link http://www.google.co.uk/search?hl=en&q= ... o.uk&meta=.

The real search nerds may find this more interesting though. http://www.google.com/insights/search/# ... lp=&cmpt=q.

www.fatmedia.co.uk