PinSleuthPinSleuthBot is the program PinSleuth uses to read the public pages of the website that a customer adds for their own Pinterest account. It finds the blog posts on that website, so PinSleuth can show which of them are already on Pinterest and which are not.
What it does
It reads the sitemap and then the blog posts listed in it, one page at a time and no faster than about one page a second in total, however many PinSleuth customers use the same website. It only reads pages that anyone can open. It only visits a website after its owner has proven it is theirs, by putting a tag or a small file with a secret code on it, or by naming it on their Pinterest profile. It never logs in, never fills in forms and never changes anything.
How to recognise it
Its name in your server log is: Mozilla/5.0 (compatible; PinSleuthBot/1.0; +https://pinsleuth.com/bot)
How to stop it
PinSleuthBot follows your robots.txt. To keep it out of your whole website, add these two lines:
User-agent: PinSleuthBot
Disallow: /
To keep it out of one folder, put that folder after Disallow. The change is picked up the next time it reads your sitemap.
Questions or a problem with how it behaves? Write to hello@pinsleuth.com and we will look at it the same day.