pim/static
Archived
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

block AhrefsBot in robots.txt

Browse source
This commit is contained in:
Pim Kunis 2023-08-24 16:07:44 +02:00
parent 7197f2e6a2
commit 31d501e45f
1 changed files with 2 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
robots.txt
View file

@ -1,2 +1,4 @@
User-agent: SemrushBot User-agent: SemrushBot
Disallow: / Disallow: /
User-agent: AhrefsBot
Disallow: /