Source Code added
This commit is contained in:
parent
800376eafd
commit
9efa9bc6dd
3912 changed files with 754770 additions and 2 deletions
8
web/static/robots.txt
Normal file
8
web/static/robots.txt
Normal file
|
|
@ -0,0 +1,8 @@
|
|||
# Allow social media access og Tags
|
||||
User-agent: *
|
||||
Allow: /share/
|
||||
Allow: /api/assets/
|
||||
|
||||
# https://www.robotstxt.org/robotstxt.html
|
||||
User-agent: *
|
||||
Disallow: /
|
||||
Loading…
Add table
Add a link
Reference in a new issue