what is robots.txt

  By Junaid A   Posted on June-22-2018 

what is robots.txt?

Answer:

this is simple robots.txt file that allow and block agents

for example.

User-agent: *
User-Agent: Googlebot

 

with the help of this file you can allow, block or deny agents and page URL as well as.

 

By  asifjans    22-Jun-2018 Views  605



Comments


Your Comments

You may also read following recent articles