Bots …

  • Creator
    Topic
  • #1237
    elephant
    Beoworld Member

      11 Users Online
      Users: elephant
      theoz
      mexking
      8 Bots <===

    Viewing 1 replies (of 1 total)
    • Author
      Replies
    • #1243
      Keith Saunders
      Administrator
        • Member Level:

        Friendly BOTS are fine provided I have allowed them to crawl the site.

        Most BOTS you see will actually be ‘web crawlers’  such as Google and Bing

        Web Crawler bots use data provided by the webmaster (me) of the web site which is provided by a combination of a site map, robot.txt and the webmaster accounts on sites like Google.

        Currently, I have set all crawlers not to index the forum until I have removed all the test posts over the next week.

      Viewing 1 replies (of 1 total)
      • You must be logged in to reply to this topic.