what is robots.txt

  By Junaid A   Posted on June-22-2018 

what is robots.txt?


this is simple robots.txt file that allow and block agents

for example.

User-agent: *
User-Agent: Googlebot


with the help of this file you can allow, block or deny agents and page URL as well as.


By  asifjans    22-Jun-2018 Views  605


Your Comments

You may also read following recent articles