Account

ShingleListBot

ShingleListBot is the crawler that helps ShingleList connect newly licensed businesses with the information they publish about themselves.

When a new business appears in public government records, our crawler may visit that business's own website a handful of times to read the contact details it publishes (like a phone number or contact email). It identifies itself as ShingleListBot/1.0, follows robots.txt, makes only a few requests per site, and doesn't crawl beyond the homepage and contact pages.

Opt out

To block the crawler, add this to your site's robots.txt:

User-agent: ShingleListBot
Disallow: /

To have your business removed from our lists, contact us and we'll take care of it.