Inferencium/website
1
0
Fork 0
Code Issues Activity

Disallow NPBot

Browse Source
This commit is contained in:
inference 2024-02-02 19:12:43 +00:00
parent ff36537e5a
commit f4d822b45a
Signed by: inference
SSH Key Fingerprint: SHA256:FtEVfx1CmTKMy40VwZvF4k+3TC+QhCWy+EmPRg50Nnc
1 changed files with 8 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
robots.txt
View File

@ -1,5 +1,5 @@
# Inferencium - Website - robots.txt # Inferencium - Website - robots.txt
# Version: 0.5.0 # Version: 0.6.0
# Copyright 2024 Jake Winters # Copyright 2024 Jake Winters
# SPDX-License-Identifier: BSD-3-Clause # SPDX-License-Identifier: BSD-3-Clause
@ -18,6 +18,13 @@ User-agent: Google-Extended
Disallow: / Disallow: /
# NameProtect (http://www.nameprotect.com/botinfo.html)
## A tool which crawls the internet in search of brand and intellectual property violations which
## may be of interest to clients. These tools have no right to scan my website for such purposes.
User-agent: NPBot
Disallow: /
# Turnitinbot (http://www.turnitin.com/robot/crawlerinfo.html) # Turnitinbot (http://www.turnitin.com/robot/crawlerinfo.html)
## A tool to scan the internet to allow educational institutions to compare content against ## A tool to scan the internet to allow educational institutions to compare content against
## students' work in order to prevent plagiarism. These tools promote a bad precedence against ## students' work in order to prevent plagiarism. These tools promote a bad precedence against