Disallow Robotstxt
Component ID
2533966
Component name
Disallow Robotstxt
Component type
module
Maintenance status
Development status
Component security advisory coverage
not-covered
Component created
Component changed
Component body
Disallow Robots TXT allows for a site to on certain servers to disallow the whole site so your dev environments aren't crawled.