diff options
| author | LinuxWizard42 <linuxwizard@voidnet.dy.fi> | 2023-03-09 19:45:06 +0200 |
|---|---|---|
| committer | LinuxWizard42 <linuxwizard@voidnet.dy.fi> | 2023-03-09 19:45:06 +0200 |
| commit | 203c06e16f528d91eaff30c5df01e277edc8fb79 (patch) | |
| tree | 2d2dadd4733e245bf2d314ff7609138c49a08f48 | |
| parent | 2c31936009e9bfb1fdaacdf8f660498bcb877594 (diff) | |
| download | VoidNet_Site-203c06e16f528d91eaff30c5df01e277edc8fb79.tar.gz VoidNet_Site-203c06e16f528d91eaff30c5df01e277edc8fb79.tar.zst | |
Added robots.txt to prevent specific directories getting listed in places like google search
| -rw-r--r-- | robots.txt | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/robots.txt b/robots.txt new file mode 100644 index 0000000..2072a0d --- /dev/null +++ b/robots.txt @@ -0,0 +1,6 @@ +User-Agent: * +Allow: / +Disallow: /files +Disallow: /icons +Disallow: /fonts +Disallow: /css
\ No newline at end of file |