# https://downloadrednote.com/robots.txt # Allow all crawlers User-agent: * Allow: / # Sitemap Sitemap: https://downloadrednote.com/sitemap.xml # Common crawl efficiency rules Crawl-delay: 10 # Disallow API endpoints and internal routes Disallow: /api/ Disallow: /_next/