Results 1 to 2 of 2
  1. #1

    What is disallow in robots.txt file?

    Hlo Friends,
    What is disallow in robots.txt file?

  2. #2
    A robots.txt file allows you to restrict the access of search engine crawlers to prevent them from accessing specific pages or directories. They also point the web crawler to your page’s XML sitemap file.

    You can use Google Search Console's Robots.txt Tester to submit and test your robot.txt file and to make sure Googlebot isn't crawling any restricted files.


Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Ad Here