The website crawler index is an advanced feature that allows you to identify IP Addresses that are associated with various search engines and crawling services. Many crawlers can be malicious in nature so we keep an index of available services.
Data is sourced via BeliefMedia. Please contact them for corrections.
