Spiders that look after themselves

Describe the data or bring Scrapy code. Every run is checked against a data contract, and broken spiders are repaired automatically, with checks before anything goes live.

Build from Claude or ChatGPT

Connect the Calyprium MCP server and let your assistant check sites, test selectors, build and run spiders, and read the results.

Fetch API

Keep your own scrapers and let Calyprium fetch the pages: anti-bot handling, browsers when needed, priced per request at the cheapest tier that works.

Pay for what the site needs

Requests start on the cheapest tier and move up only when a site refuses them. Budgets, policies and cost suggestions keep spend in check.

Datasets

Merge many spiders into one table with a shared schema, provenance and quality checks, and deliver it to your own storage.

Config as code

Keep spiders, contracts, policies, datasets and webhooks in git, and apply them with calyprium apply.