sharpetronics/sharpetronics.com
1
0
Fork 0
Code Issues 5 Pull Requests Projects Releases Wiki Activity

add robots.txt for crawl access
Some checks reported errors
continuous-integration/drone/push Build was killed
Details

Browse Source
This commit is contained in:
oDinZu 2022-11-26 17:33:13 -05:00
parent 20bad105d4
commit ed4919d597
1 changed files with 1 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
robots.txt
View File

@ -1,6 +1,4 @@
User-agent: * User-agent: * Disallow: # allows all bots and users to crawl the site.
Allow: /*.html$
Disallow: /assets/*
Sitemap: https://www.sharpetronics.com/sitemap.xml Sitemap: https://www.sharpetronics.com/sitemap.xml
#____ __ ______ #____ __ ______
#/\ _`\ /\ \ /\__ _\ __ #/\ _`\ /\ \ /\__ _\ __