jeudi 2 août 2018

Robots.txt

i have prepare robots.txt file in which i want to allow all search engines to crawl all pages of my site except three pages. my file looks like following:

User-Agent: *
Disallow:/indexA.html

User-Agent: *
Disallow:/indexA.php

User-Agent: *
Disallow:/index-login.php

Do This file is right or do i have done some mistakes?


Read More : Robots.txt
from A2S.in - Make Money Online

Aucun commentaire:

Enregistrer un commentaire