Install guides

Add to Cloudflare

Approve Intercrawl once on Cloudflare, and a small Worker is placed in front of your site.

For a site whose domain is on Cloudflare. You approve Intercrawl once on Cloudflare's own page; Intercrawl places a small Worker in front of your domain. Crawlers asking for a page get Intercrawl's rendered version; visitors get your site exactly as now. No code and no DNS change.

Steps

  1. On the Sites page, open your site's install guide and choose Add to Cloudflare.
  2. Approve Intercrawl on Cloudflare's page. It asks to read your zones and to add Workers and their routes.
  3. Intercrawl adds the Worker and a route for your domain and its www. (where they are proxied), checks your homepage, and gives the access back. Cloudflare keeps no access for Intercrawl.

If the site is not verified yet, approving also verifies it, through the Cloudflare account whose zone holds the domain.

What to know

  • The Worker runs on every request to your domain. On Cloudflare's free Workers plan that counts toward its 100,000 requests a day; past them your site is served without the Worker, never with an error.
  • If Intercrawl cannot answer in time, the Worker serves your own page.

Disconnecting

Disconnecting stops rendering at once. The Worker stays in your Cloudflare account and serves your own pages until you delete it: in Cloudflare, open Workers and Pages, the Worker named intercrawl- followed by your domain, Settings, then Delete. Its routes go with it.

Not answered here? Write to hello@intercrawl.com.Next: Install with AI