Home Explore Help
Sign In
universai
/
masyunis
1
0
Fork 0
Files Issues 0 Pull Requests 0 Wiki
Tree: eb3e46d8d0
Branches Tags
masyunis
/
cmd
/
robots2policy
/
testdata
/
simple.robots.txt

simple.robots.txt 90 B
History Raw

12345 
  1. # Simple robots.txt test
    2. 

  2. User-agent: *
    3. 

  3. Disallow: /admin/
    4. 

  4. Disallow: /private
    5. 

  5. Allow: /public
    6.