User-agent: * Disallow: /api # Sitemap Sitemap: https://arcruit.com/sitemap.xml # Crawl-delay Crawl-delay: 1