# www.mukken.com — public site
#
# This file controls CRAWLING only. Indexing is controlled per page by the
# robots meta tag, which SearchController sets to noindex on multi-facet,
# instrument-only, radius-filtered and paginated search pages.
#
# Those URLs are therefore deliberately left crawlable: a Disallow here would
# stop Google fetching them, and a page it cannot fetch is a page whose noindex
# it can never read. Blocking them would strand them in the index rather than
# remove them.

User-agent: *
Disallow: /login/
Disallow: /cache/

Sitemap: https://www.mukken.com/sitemap.xml