block robots from scraping api routes
This commit is contained in:
parent
cb9b011013
commit
c452ec4b12
@ -1,3 +1,3 @@
|
|||||||
# https://www.robotstxt.org/robotstxt.html
|
# https://www.robotstxt.org/robotstxt.html
|
||||||
User-agent: *
|
User-agent: *
|
||||||
Disallow:
|
Disallow: /api
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user