Grovik

Letting Grovik read your site

The setting to change, in the products it is usually in

Someone has asked for a Grovik audit of a website you look after, and the site turned our reader away before it could see any pages. This page is how to let it through. It usually takes about two minutes.

You are looking for a setting called bot protection, firewall or allow list — whichever of these you use.

Cloudflare

  1. Open the Cloudflare dashboard and pick the website.
  2. Go to Security → WAF → Tools.
  3. Under User Agent Blocking, check that nothing there matches GrovikBot.
  4. Then go to Security → Settings and, if Bot Fight Mode is on, add a skip rule: Security → WAF → Custom rules → Create rule, with the expression (http.user_agent contains "GrovikBot") and the action Skip → All remaining custom rules.

If you use Cloudflare's Super Bot Fight Mode, set Definitely automated to Allow for this rule, or add the same skip rule above it.

Wordfence (WordPress)

Wordfence → Firewall → Blocking, then remove or disable any rule that blocks GrovikBot or blocks by user agent. If rate limiting is on, Wordfence → Firewall → Rate Limiting has an allow-list field for crawlers.

Sucuri

Firewall (WAF) → Access Control → Whitelist, and add GrovikBot under Whitelist a User-Agent.

Squarespace, Wix, Shopify and other hosted platforms

These do not expose a bot allow list. If an audit is refused on one of them it is almost always temporary rate limiting rather than a block — waiting a few minutes and running it again is normally enough.

Your own server (nginx, Apache, or a WAF in front of it)

Look for a rule matching on user agent. Ours identifies itself as:

GrovikBot/1.0 (+https://grovik.ai/bot)

It requests HTML pages only, up to twenty of them on a free audit, a few at a time, and it never submits a form or logs in.

If you would rather it stayed out

That is a fine answer and it needs no firewall rule. Put this in the site's /robots.txt:

User-agent: GrovikBot
Disallow: /

The free audit reads that file before it requests anything, so nothing on the site will be read, and whoever asked for the audit is told the site declined.

One exception, deliberately: an audit run by a customer on a site they have added to their own Grovik account goes ahead. Asking us for an audit of your own site answers the same question directly.

Still stuck

Email support@grovik.ai with the domain and we will tell you exactly what we saw, including the response your server sent us.