Crawler policy

About CrawdarBot

CrawdarBot reads public business websites when a user requests a business research list. It identifies itself as CrawdarBot/1.0, respects robots.txt, rate limits requests, and does not attempt to access logins or bypass technical controls.

Opting out

Block CrawdarBot in robots.txt or email crawler@crawdar.com with the domain you manage. We will review verified removal requests.

What it extracts

Company names, public role-based contact details, phone numbers, business location, ownership indicators, and source evidence. Crawdar is not designed to collect sensitive personal information.