Inferencium/website
1
0
Fork 0
Code Issues Activity

Add file "robots.txt"

Browse Source 
"robots.txt" is a file which allows the website owner to disallow bots,
crawlers, scrapers, and other potentially malicious or unwanted
behaviour on their website.
This commit is contained in:
inference 2024-02-02 18:53:20 +00:00
parent a959c31b3e
commit 03d7141525
Signed by: inference
SSH Key Fingerprint: SHA256:FtEVfx1CmTKMy40VwZvF4k+3TC+QhCWy+EmPRg50Nnc
1 changed files with 5 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
robots.txt Normal file
View File

@ -0,0 +1,5 @@
# Inferencium - Website - robots.txt
# Version: 0.1.0
# Copyright 2024 Jake Winters
# SPDX-License-Identifier: BSD-3-Clause