Install guides
Add to Vercel
One routing rule in your Vercel project, added for you. No code and no deploy.
Intercrawl adds one routing rule to the Vercel project that serves your domain. Crawlers asking for a page get Intercrawl's rendered version; visitors get your site exactly as now.
Steps
- On the Sites page, open your site's install guide and choose Add to Vercel.
- Choose how crawlers are checked (the table below explains both).
- In Vercel, signed in to the account that owns the project, open Account settings, Tokens, and create a token: for Scope, choose the team that owns the project, then All Projects; a short expiry such as one day is enough.
- Copy the token, paste it on the Sites page and connect.
| Choice | What it does |
|---|---|
| Check each crawler's IP (recommended) | Intercrawl checks the visitor address Vercel reports against each crawler's published IP ranges. A request that only claims to be a crawler gets your own page and uses no render. |
| Don't check IPs | Every request that names a crawler gets a rendered page, fake ones included. Those renders count toward your site's daily renders. |
Intercrawl uses that token once, to add the rule, and never stores it. You can delete it in Vercel afterwards. If the site is not verified yet, connecting also verifies it: Intercrawl checks that the Vercel project really serves the domain, with a temporary rule it removes within seconds.
What to know
- The rule holds a dedicated Intercrawl API token, visible to anyone who can open the project's settings on Vercel.
- If a render fails, Intercrawl serves your own page. If Intercrawl cannot be reached at all, Vercel has no fallback, and crawlers get an error until it is back.
- When Intercrawl adds crawlers to its list, disconnect and connect again to bring the rule up to date.
Disconnecting
Disconnecting stops rendering at once and revokes the rule's token. Intercrawl cannot remove the rule from your project, and until you do, crawlers get your own pages through it. To remove it in Vercel: open the project, then CDN, then Routing Rules; find the rule named Intercrawl and delete it; select Publish. Then press The rule is gone on the Sites page.