Docs

Robots.txt

Suggest Edits

onCourse automatically generates a robots.txt file, with a pointer to the sitmap.xml which is also automatically generated.

If you have specific pages on your website you’d like to stop search engines from crawling, you can manually add a robots.txt file to the folder /templates/default/. You can then add 'disallow' commands using the following syntax:

Disallow: /room/200
Disallow: /course/abc123/

Don’t forget to add the link to sitemap.xml as well if you override this asset.

It is not necessary to hide class pages, or any page which you have otherwise hidden (such as a site you no longer use). onCourse will automatically remove them from the sitemap.xml or add noindex meta headers as needed.

Updated 6 months ago