Save a site
One URL becomes a monitored project with its own history and trends.
Reach / Monitor▊
Know what changed before it costs you traffic.
Crawlie watches your site, tells you when something slips, and shows you exactly what changed. Set it once, then get on with your week.
Project health
acme.com
12 Jun19 Jun26 JunToday
Set the cadence
Hourly to monthly, timezone-aware. Crawls run whether or not you're awake.
Get told what changed
Alerts on regressions, engines pinged on changes. Silence means healthy.
Why it wins
Built different where it counts.
Diffs, not dashboards
Every scheduled crawl is compared with the last one. You see the pages and issues that changed, without rereading the whole report.
Alerts where you work
Email and Slack/Discord webhooks fire on health drops, new error-severity issues, or content-rule regressions. Silence means healthy.
Instant indexing built in
When pages change, Crawlie lets participating search engines know through IndexNow. No extra job to remember.
Schedules
Set the cadence, forget the tab
Hourly to monthly, time-of-day and timezone aware, DST handled. Crawls run on our servers whether or not you're awake, and every one lands in the project's history with trend lines.
- Hourly, daily, weekdays, weekly, monthly or custom day sets
- Score trends across every crawl
- Agents can set up monitoring over MCP
Schedule weekdays · 09:00
Email alerts on
Slack webhook connected
Instant indexing key verified
Last crawl 7,301 pages
Quiet when healthy
You’ll only hear from Crawlie when something needs you.
Every scheduled run is compared with the last. If the site’s healthy, there’s no “crawl complete” noise.
MTWTFSS
09:00Europe / London
Everything’s steady.
No regressions. No email.
Last checked 8 minutes agoHealth dropped 4 points
+3 broken internal links
+1 redirect chain on /docs
Open the diff →Send it where work happens
Email, Slack, Discord or your own webhook.
EmailOn
Slack webhookConnected
API + MCPReady
Set up alerts →A history you can use
Every crawl becomes a receipt.
See the change, the deploy that caused it and the crawl that proved it was fixed. You don’t have to reconstruct the story from screenshots.
- Health, GEO and Accessibility trends
- Pages added and removed
- Issues appeared and resolved
- Custom-rule regressions
Health 8212 issues resolved
Health 754 new errors found
Deploy detected37 changed URLs
Health 79Baseline crawl
BingYandexNaverSeznamYep
37changed URLs sent
IndexNow built in
Changed pages get a nudge, automatically.
Crawlie sends only the URLs that appeared, changed or disappeared. Every push is logged beside the crawl, so you know what was submitted and when.
Start monitoring free →Agent-native
Your agents get the same superpowers.
Everything on this page is a tool call away. The hosted MCP server exposes 18 tools — crawls, reports, fixes, monitoring — and the REST API speaks the same JSON. One key, no scraping, no glue code.
- Hosted MCP endpoint for Claude, Cursor and any MCP client
- REST API with the same capabilities, self-describing
- Open-source CLI + local MCP if you'd rather stay on your machine
> watch acme.com, tell me if SEO slips
create_project { "url": "acme.com" }
set_schedule { "schedule": "daily" }
✓ monitoring live · alerts → email
project_trend → health 79 → 82 ↑
diff_reports → what changed, structured
one prompt · zero dashboards opened
How often can Crawlie crawl my site?
Anywhere from hourly to monthly: hourly, daily, weekdays, weekly, monthly or a custom set of days, at the time of day and timezone you choose. Hourly monitoring is available on Business and Scale; daily to monthly on every paid plan. Crawls run on Crawlie's servers, so nothing needs to stay open on your machine.
What does Crawlie alert me about?
Health-score drops, new error-severity issues and custom-rule regressions — delivered by email or a Slack, Discord or custom webhook. Every scheduled crawl is diffed against the last, and if nothing regressed, Crawlie stays quiet.
What is IndexNow and which search engines does it reach?
IndexNow is a protocol that tells search engines a URL changed so they can recrawl it sooner. When a scheduled crawl finds pages that appeared, changed or disappeared, Crawlie submits just those URLs to participating engines — Bing, Yandex, Naver, Seznam and Yep. Google does not use IndexNow.
What does a crawl-to-crawl diff show?
Score changes across Health, GEO and Accessibility, pages added and removed, and issues that appeared or were resolved — so you see exactly what a deploy did instead of rereading the whole report.
Can my AI agent set up monitoring for me?
Yes. Over the hosted MCP server an agent can create a project, set the crawl schedule and read trends — create_project, set_schedule and project_trend are all first-class tools.
Point Crawlie at your site.
Free to start on the Hobby plan — 5,000 crawl credits a month, no card required.