API & pricing →

Generate a valid llms.txt for any site

AI assistants increasingly look for llms.txt at a site's root. This tool crawls a site (same host, up to 20 pages), then builds the index file for you. Free — a no-card API key is created for you automatically.

Uses the same engine as the RagScrape API. Docs sites work best.

  1. Save the file as llms.txt
  2. Upload it to your site root so it's served at https://yoursite.com/llms.txt
  3. AI tools and agents can now index your site properly. Regenerate when your docs change — or automate it with the RagScrape API.