About our bot, ArPasiruoseBot
ArPasiruoseBot is the program that checks websites when our customers ask it to.
When it visits
Only when a customer adds a page, asks for a recheck, or once a month automatically. We only check one page of the same website at a time.
What it opens
The page itself, robots.txt, llms.txt, the sitemap, and up to 50 links from the page to see whether they work. We send no more than 60 requests to your website per check. We also open the page like a browser to measure its speed.
Why it sometimes uses other names
To check whether your firewall lets AI assistants in, we open the page a few times under their bot names, like GPTBot. It's only a handful of requests per check.
Does it follow robots.txt
We read robots.txt to show the owner what it allows and blocks. It doesn't stop our check, because the website's owner or their team asked for it.
How to recognise it
User agent:
ArPasiruoseBot/1.0 (+https://arpasiruose.lt/botas)
Don't want it to visit?
Write to [email protected] and tell us your website.