# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # Allow all search engines to crawl the site User-agent: * Allow: / # Disallow admin and API endpoints Disallow: /admin/ Disallow: /api/ # Sitemap location Sitemap: https://smr.nucnet.org/sitemap.xml Sitemap: https://www.nucnet.org/sitemap.xml