Crawler

Content version: 2026-10-14

About GrimlaBot

GrimlaBot is the crawler of Grimla, a product discovery service for verified online shops. It visits online shops to collect the public business information that powers our verification directory — the same details a shop is required to display. It identifies itself as GrimlaBot and links back to this page.

Recognising GrimlaBot

Its user agent is Mozilla/5.0 (compatible; GrimlaBot/1.0; +https://grimla.com/bot).
GrimlaBot requests are identified by the user agent and a cryptographic Web Bot Auth signature. Public keys are published at https://grimla.com/.well-known/http-message-signatures-directory.
While all nodes use exits, /bot/ips.txt contains comments only. Rotating exit addresses are not published. If direct mode is enabled, the file lists only the direct nodes' request addresses.

What we look at

Your home page and public business pages (imprint, terms, privacy, returns, contact)
A few category pages, to see what you sell
For listed shops, your product feed — so prices stay current, refreshed about once a day

How GrimlaBot behaves

It reads only a small number of pages per shop
It limits how many requests it makes at once
It checks your robots.txt first

Opt out — any one of these

Add this to your robots.txt:
```
User-agent: GrimlaBot
Disallow: /
```
Or, as an alternative, add this to your page <head>:
```
<meta name="grimlabot" content="noindex">
```
Or email [email protected] from an address at your shop’s domain, so we can confirm the request is really yours.