StoreCheckBot
StoreCheckBot fetches a few public pages of a store only when a visitor asks for a check of that store on this page. It:
- identifies itself with the user agent
StoreCheckBot/1.0and a link to this page; - reads and obeys
robots.txt(block it withUser-agent: StoreCheckBot/Disallow: /); - makes at most 16 requests per check, one at a time with a pause between them, and limits how often any one store can be checked;
- doesn't log in, submit forms, add to cart or run JavaScript.
Questions or problems: labourchef@gmail.com.