Episerver has a great development community who built modules that you can integrate with Episerver. Below lists the modules that I recommend you use in your Episerver project.
Robots.txt allows you to update your robots.txt file from from within the Episerver admin.
Having a Sitemap in your website is a good practice to help search robots to index your website. I recommend using the geta Sitemap package, available here. The plugin is split into two parts. First, you will need to configure about what content you want to be included in your sitemap, the second step is enabling a scheduled task to ensure it gets updated.
To configure the plug-in, load up your Episerver website, and again you will need to visit the admin section. From here you will see a new section,
‘Search engine sitemap settings’.
From the settings page, you will need to create a new Sitemap. Configuring the plug-in is fairly straightforward and all the instructions are on the page. I usually create a Sitemap that indexes everything so I tend to leave everything blank After saving the content, you will need to enable the scheduled task to update it.
In the admin pages, ‘Scheduled Jobs’ section, click on the ‘Generate search engine sitemaps’ section. Click the ‘Start Manually’ button and your Sitemap will be generated.
After triggering the scheduled task, when you type in /sitemap.XML onto your website’s URL in a browser, you should now see an XML file that contains all your website’s content.
As content is changing the site will need a way to deal with 301 redirects. Asides, from the IIS Url Rewrite module, I recommend the BVN redirect module is installed to allow content editors/admins the ability to create redirect rules without needing to deploy code.
After the plugin is installed it has two functions. First 301 re-directs. Setting the 301 redirect is done via the dashboard gadget.
Creating a redirect is simple, in the ‘Custom Redirects’ tab, add the old URL and the URL you want the 301 to point to, click ‘Add’ and off you go. From previous project experience, I would say it’s good practice to manage this list. If the list gets too large it can affect performance a little. In most cases, after 6 months you can kill off any new/old re-directs.