What we have shipped recently.
No AI company publishes a readiness score, so the 215-point score is replaced by five technical checks that search and AI engines document: search crawlers allowed on your homepage, Googlebot allowed on your important pages, no noindex, snippets allowed, and pages that load. The header reads "X of Y technical checks pass", each check lists the exact pages behind it, and anything we cannot verify shows as not verified instead of counting. Internal links, readable text, business pages, structured data and brand evidence are shown as information, not scored. Earlier scores are kept as history and never compared with the checklist.
Backlinks can now refresh about once a week for active projects. A link is marked lost only when a complete check confirms it is gone; if your site has more backlinks than one check covers, missing links are kept instead of being marked lost. Links that come back are restored.
llms.txt is now an informational check (Google Search does not use it), so the maximum is 215. Robots access is scored only for search crawlers such as Googlebot, Bingbot and OAI-SearchBot; blocking training crawlers like GPTBot or Google-Extended never lowers the score. If robots.txt cannot be read, the check says so instead of reporting access as allowed. Scores from before this change are not compared with new ones.
The readiness audit grew from 9 factors (165 max) to 12 factors (230 max), adding AI crawler access checks, llms.txt content mapping, and answerability analysis. Every factor scores separately with its own recommended actions.
Rebuilt the public site with dedicated pages for features, pricing, about, help, contact, and legal. Shared marketing header/footer across all public pages. Blog integrated into site navigation.
Added dedicated pages for Site Audit, Keywords, Backlinks, AI Visibility, and Content Studio. Each explaining capabilities, workflows, and tier availability.
Full blog content management system with rich text editing, real-time SEO scoring (0-100), AI-powered title/meta/outline suggestions, media library, scheduled publishing, and public blog with SSG/ISR.
3-column blog layout with sticky table of contents (active heading highlight), suggested reading sidebar, and smooth scroll anchoring.
Admin dashboard with user/workspace management, tier overrides, operations monitoring, and audit logging. Frontend access gated by isSuperAdmin check.
Added paid extra team seats at $6/month per seat via Stripe quantity-based pricing. Seat confirmation dialogs and billing page updates.
Per-issue AI advice that explains why an issue matters and suggests a specific fix, drawing on health score, GSC traffic data, and bot crawl patterns.
Upload and analyze server access logs (Apache, Nginx, CloudFront). Bot detection, crawl frequency analysis, budget waste identification, and uncrawled page discovery.
Daily GSC sync with top 100 queries/pages, configurable date ranges. GSC-weighted issue prioritization. Pages with real traffic get higher priority scores.
Health score drops, new issue spikes, GSC traffic drops, keyword rank drops, crawl events, and usage warnings. Configurable thresholds per workspace.
Weighted 0-100 health score factoring severity, category importance, and page value. Historical snapshots per crawl with trend charts, category subscores, and change explanations.
Track brand presence in ChatGPT and Google AI Overviews via DataForSEO LLM Mentions API. Prompt discovery, competitor monitoring, and 9-factor AI readiness score.
Full backlink sync with 35+ data points per link. Lost link detection, referring domains breakdown, outreach opportunity management, and AI-drafted outreach emails.
Shared export utility for Pages, Keywords, Backlinks, Issues, and AI Prompts. Exports respect current filters and fetch up to 5,000 rows.
Compare keyword coverage against competitors. Opportunities scored by search volume, difficulty, and number of competitors ranking.
Keyword research with search volume, CPC, difficulty. Domain analysis, SERP tracking, keyword clustering, and persistent research results that build your keyword library.
Two-tier action items (active + suggested) with auto-detection, batching for large issue sets, impact/difficulty scoring, and step-by-step fix guides for all issue types.
Connect WordPress (REST API), Webflow (API v2), or Shopify (Admin API). Update titles and meta descriptions on WordPress, and publish articles to WordPress, Webflow and Shopify.
We ship improvements every week. Start using CrawlTide and see them as they land.
Get started free