{"id":271,"date":"2021-08-25T13:26:05","date_gmt":"2021-08-25T17:26:05","guid":{"rendered":"http:\/\/www.tracemyip.org\/learn\/?post_type=ht_kb&p=271"},"modified":"2023-03-13T14:25:50","modified_gmt":"2023-03-13T18:25:50","slug":"how-to-stop-tracking-web-crawlers","status":"publish","type":"ht_kb","link":"https:\/\/www.tracemyip.org\/learn\/how-to-stop-tracking-web-crawlers-271\/","title":{"rendered":"How to stop tracking web crawlers"},"content":{"rendered":"

This guide explains how to prevent<\/strong> most common web crawlers<\/a><\/strong> from redundant<\/b> utilization of the visitor traffic log and appearing on your website tracking<\/a> reports.<\/p>\n

A web crawler<\/strong> is an Internet website scouting bot (script) that periodically scans websites<\/strong> typically for the purpose of indexing web pages<\/strong>. Other web bots extract information from websites for the purpose of data mining.<\/p>\n

\ud83d\udcc8 Sign Up<\/a><\/strong> now to instantly<\/strong> track website visitors<\/a> IPs!<\/p>\n

Blocking website crawlers from being logged by the Visitor Tracker<\/h2>\n

Blocking a website bot from being logged by the tracker does not block the bot from accessing a website but rather tells the tracker system to ignore bots visits.<\/p>\n

<\/p>\n

    \n
  1. Navigate to \u201cMy Projects<\/strong>\u201d page. Locate the project that you need to stop logging web crawlers and click on the \u201cedit\u201d link.<\/li>\n
  2. Find the \u201cLog Filter<\/strong>\u201d drop-down menu and select \u201cDo NOT Log Robot Visits\u201d<\/li>\n
  3. Scroll to the bottom of the page and click on the \u201cUpdate\u201d Button.<\/li>\n<\/ol>\n

    On \u201cMy Project<\/strong>s\u201d page, you can now visually confirm that the feature is enabled by observing a corresponding robot icon displayed under the status screen. \"blocking-web-crawlers-setting-enabled\"<\/p>\n

    If you need to completely stop tracking<\/a> visitor activity, you can temporarily enable a “Suspend Tracking” option.<\/p>\n

    \ud83d\udcc8 Sign Up<\/a><\/strong> now to instantly<\/strong> track website visitors IPs!<\/p>\n

     <\/p>\n

    <\/div>","protected":false},"excerpt":{"rendered":"

    This guide explains how to prevent most common web crawlers from redundant utilization of the visitor traffic log and appearing on your website tracking reports. A web crawler is an Internet website scouting bot (script) that periodically scans websites typically for the purpose of indexing web pages. Other web bots…<\/p>\n","protected":false},"author":1,"comment_status":"closed","ping_status":"closed","template":"","format":"standard","meta":{"footnotes":""},"ht-kb-category":[4],"ht-kb-tag":[32,33,31,30],"class_list":["post-271","ht_kb","type-ht_kb","status-publish","format-standard","hentry","ht_kb_category-project-settings","ht_kb_tag-bots","ht_kb_tag-crawlers","ht_kb_tag-stop","ht_kb_tag-tracking"],"_links":{"self":[{"href":"https:\/\/www.tracemyip.org\/learn\/wp-json\/wp\/v2\/ht-kb\/271","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tracemyip.org\/learn\/wp-json\/wp\/v2\/ht-kb"}],"about":[{"href":"https:\/\/www.tracemyip.org\/learn\/wp-json\/wp\/v2\/types\/ht_kb"}],"author":[{"embeddable":true,"href":"https:\/\/www.tracemyip.org\/learn\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tracemyip.org\/learn\/wp-json\/wp\/v2\/comments?post=271"}],"version-history":[{"count":4,"href":"https:\/\/www.tracemyip.org\/learn\/wp-json\/wp\/v2\/ht-kb\/271\/revisions"}],"predecessor-version":[{"id":2069,"href":"https:\/\/www.tracemyip.org\/learn\/wp-json\/wp\/v2\/ht-kb\/271\/revisions\/2069"}],"wp:attachment":[{"href":"https:\/\/www.tracemyip.org\/learn\/wp-json\/wp\/v2\/media?parent=271"}],"wp:term":[{"taxonomy":"ht_kb_category","embeddable":true,"href":"https:\/\/www.tracemyip.org\/learn\/wp-json\/wp\/v2\/ht-kb-category?post=271"},{"taxonomy":"ht_kb_tag","embeddable":true,"href":"https:\/\/www.tracemyip.org\/learn\/wp-json\/wp\/v2\/ht-kb-tag?post=271"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}