# Lucky robots.txt # Controls which pages search engines can crawl User-agent: * Allow: / # Protected user pages Disallow: /settings # Block staging and development environments Disallow: /api/ Disallow: /monitoring/