Add robots.txt
This commit is contained in:
parent
8d07f445c0
commit
ffd0bfb85f
2 changed files with 9 additions and 0 deletions
8
src/robots.txt
Normal file
8
src/robots.txt
Normal file
|
|
@ -0,0 +1,8 @@
|
|||
User-agent: GPTBot
|
||||
Disallow: /
|
||||
|
||||
User-agent: Googlebot
|
||||
Disallow: /
|
||||
|
||||
User-agent: Bingbot
|
||||
Disallow: /
|
||||
Loading…
Add table
Add a link
Reference in a new issue