User-agent: * Allow: / # Searches cost: crawl no query. The search page itself says noindex, which # crawlers have to fetch it to read. Disallow: /docs/search/? Disallow: /api/ Sitemap: https://fctl.sh/sitemap.xml