The system automatically generates multilingual sitemaps and a corresponding robots.txt for content that can be configured.