Install guides
Install on Cloudflare Pages
One middleware file for a Cloudflare Pages project.
Steps
- Create an API token on the Account page and copy it.
- In your Pages project, add
INTERCRAWL_TOKENas a secret under Settings, Variables and Secrets. - Save the install file in your project:
Save asfunctions/_middleware.tsintercrawl.com/install/v1/pages.ts
- Deploy, then press Check install on the Sites page.
Cloudflare gives the function each visitor's real IP address, so every crawler request is checked against its operator's published addresses.
Not answered here? Write to hello@intercrawl.com.Next: Install as a Cloudflare Worker