Bots …

  • Creator
  • #1237
    Beoworld Member

      11 Users Online
      Users: elephant
      8 Bots <===

    Viewing 1 replies (of 1 total)
    • Author
    • #1243
      Keith Saunders
        • Member Level:

        Friendly BOTS are fine provided I have allowed them to crawl the site.

        Most BOTS you see will actually be ‘web crawlers’  such as Google and Bing

        Web Crawler bots use data provided by the webmaster (me) of the web site which is provided by a combination of a site map, robot.txt and the webmaster accounts on sites like Google.

        Currently, I have set all crawlers not to index the forum until I have removed all the test posts over the next week.

      Viewing 1 replies (of 1 total)
      • You must be logged in to reply to this topic.