Naven
Glossary
robots.txt
A file telling crawlers which parts of a site not to fetch.
It controls crawling, not indexing — a disallowed URL can still appear in results if it is linked from elsewhere. Keeping something out of an index is a noindex tag's job, and a page blocked in robots.txt can never be read to discover its noindex.
It is also where a sitemap is conventionally announced.
Where Naven stands
Naven's names its sitemap and leaves the public pages open.