This repository has been archived on 2024-04-26. You can view files and clone it, but cannot push or open issues or pull requests.
static/robots.txt

8 lines
136 B
Text

User-agent: SemrushBot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: DotBot
Disallow: /
User-Agent: FacebookBot
Disallow: /