From 2be143b9f193c49a66b80038d6b793b1208d8eab Mon Sep 17 00:00:00 2001 From: Devon Campbell Date: Mon, 3 Mar 2025 19:03:31 -0500 Subject: [PATCH] Disallow all robots because this web site is for humans. Not that it will matter since the robots just ignore this altogether now, but I want to make it clear they're not welcome. Might implement a way to poison the content for them down the line. --- src/robots.txt | 8 +------- 1 file changed, 1 insertion(+), 7 deletions(-) diff --git a/src/robots.txt b/src/robots.txt index c561232..1f53798 100644 --- a/src/robots.txt +++ b/src/robots.txt @@ -1,8 +1,2 @@ -User-agent: GPTBot -Disallow: / - -User-agent: Googlebot -Disallow: / - -User-agent: Bingbot +User-agent: * Disallow: /