Skip to content
UnvelloWeb

For site owners

UnvelloBot

UnvelloBot reads a small number of public pages when someone asks UnvelloWeb to audit a website.

How it behaves

  • It identifies itself as UnvelloBot/1.0 with a link to this page.
  • It reads your robots.txt first and follows it. If the homepage is disallowed, it stops.
  • It fetches about one page per second and reads at most a few dozen pages per audit on the free plan.
  • It never tries to get around bot protection, logins or paywalls.
  • It only reads public pages and never submits forms. On paid plans it may run a page's JavaScript in a browser to read content built there.

Block or limit it

Add this to your robots.txt to stop UnvelloBot from crawling your site:

User-agent: UnvelloBot
Disallow: /

To have your domain excluded from audits entirely, contact us from an address at that domain. Opted-out domains are added to our block list and can't be audited by anyone.