Skip to content

Commit

Permalink
Add Crawl-delay to robots.txt
Browse files Browse the repository at this point in the history
  • Loading branch information
@zedeus
zedeus committed Jan 8, 2023
1 parent b5dee25 commit 6c4c691
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions public/robots.txt
View file
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
User-agent: *
Disallow: /
Crawl-delay: 1
User-agent: Twitterbot
Disallow:

0 comments on commit 6c4c691

Please sign in to comment.