Agent Readiness Scan

Scans any website and scores how well it is optimised for AI agents — robots.txt, sitemap, llms.txt, llms-full.txt, markdown content-negotiation, MCP server card, and more. Returns a score out of 100, a letter grade, and per-check pass/warn/fail results with improvement suggestions. Using Clay? See /integrations/clay for the copy-paste HTTP API column setup.

POSThttps://www.startuphub.ai/api/v1/agent-readiness

Request

curl -X POST "https://www.startuphub.ai/api/v1/agent-readiness" \
  -H "Authorization: Bearer sk_live_..." \
  -H "Content-Type: application/json" \
  -d '{ "url": "https://anthropic.com" }'

Parameters

urlstringrequired

Full URL of the website to scan (e.g. https://anthropic.com)

Response

json

{
  "data": {
    "url": "https://anthropic.com",
    "totalScore": 82,
    "grade": "A",
    "categories": [
      { "category": "crawlability", "label": "Crawlability", "score": 100, "passed": 3, "total": 3 },
      { "category": "content", "label": "Content", "score": 75, "passed": 3, "total": 4 },
      { "category": "agent_protocols", "label": "Agent Protocols", "score": 60, "passed": 2, "total": 3 }
    ],
    "checks": [
      {
        "id": "robots-txt",
        "label": "robots.txt present",
        "status": "pass",
        "category": "crawlability",
        "weight": 3,
        "detail": "robots.txt found and accessible."
      },
      {
        "id": "llms-txt",
        "label": "llms.txt present",
        "status": "fail",
        "category": "agent_protocols",
        "weight": 3,
        "detail": "No llms.txt found. Add one at /llms.txt to help agents discover your site structure.",
        "fix_prompt": "Create /llms.txt at your site root listing your most important URLs (one per line, plain text). Example:\nhttps://example.com/about\nhttps://example.com/products\nhttps://example.com/api-docs\nThis is the primary discovery file for AI agents."
      }
    ],
    "markdown": "## Agent Readiness Report\n**Score:** 82/100 (A)\n...",
    "scannedAt": "2026-04-23T12:00:00.000Z",
    "totalMs": 1840
  },
  "credits": { "used": 1, "limit": 50, "remaining": 49 }
}

PreviousLogo Lookup Next Deep Intelligence Preview