add robots.txt for crawl access
All checks were successful
continuous-integration/drone/push Build is passing
All checks were successful
continuous-integration/drone/push Build is passing
This commit is contained in:
parent
ed4919d597
commit
a0e1df26ac
@ -1,4 +1,5 @@
|
||||
User-agent: * Disallow: # allows all bots and users to crawl the site.
|
||||
# allows all bots and users to crawl the site.
|
||||
User-agent: * Disallow:
|
||||
Sitemap: https://www.sharpetronics.com/sitemap.xml
|
||||
#____ __ ______
|
||||
#/\ _`\ /\ \ /\__ _\ __
|
||||
|
Loading…
x
Reference in New Issue
Block a user