From 03d7141525caf655082fb80ddd8dc54c3f0478c4 Mon Sep 17 00:00:00 2001 From: inference Date: Fri, 2 Feb 2024 18:53:20 +0000 Subject: [PATCH] Add file "robots.txt" "robots.txt" is a file which allows the website owner to disallow bots, crawlers, scrapers, and other potentially malicious or unwanted behaviour on their website. --- robots.txt | 5 +++++ 1 file changed, 5 insertions(+) create mode 100644 robots.txt diff --git a/robots.txt b/robots.txt new file mode 100644 index 0000000..5025726 --- /dev/null +++ b/robots.txt @@ -0,0 +1,5 @@ +# Inferencium - Website - robots.txt +# Version: 0.1.0 + +# Copyright 2024 Jake Winters +# SPDX-License-Identifier: BSD-3-Clause