This API provides six keyless GET endpoints for tasks like crawler-IP verification, robots.txt linting, AI-access auditing, and user-agent classification. These endpoints require no accounts or API keys, allowing seamless access while ensuring compliance with CORS and caching policies.
Build a crawler-aware dashboard to see which bots visit your site, add a verification step before trusting a UA claim, or auto-generate robots.txt stances for your hostname. You call simple, keyless GET endpoints or connect via the MCP stream endpoint for richer clients. The data is read-only, refreshed regularly, and published as CC0 so you can reuse it freely. The host recommends caching and notes a practical 100,000 requests/day site limit.
Currently, there are no Showcases using this API.
Currently, there are no Comments for this API.
This API has no tags yet. Select some below, so other users can find it!