Webmaster Tool - Robot.txt Creator - Back to tools page
Use this free tool to generate robot.txt meta-tag. This will guide search engine indexer robots.
Quick Note:
This is only for the Meta Tag in the head section of your Webpage. Use the robot.txt file located in your server for more detailed and accurate settings.
This generator only works on JavaScript enabled browsers. For more info about this script visit http://javascriptsource.com and http://en.wikipedia.org/wiki/Robots.txt
Did You Know?
The robots exclusion standard, also known as the Robots Exclusion Protocol or robots.txt protocol is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is, otherwise, publicly viewable. Robots are often used by search engines to categorize and archive web sites, or by webmasters to proofread source code. A robots.txt file on a website will function as a request that specified robots ignore specified files or directories in their search. This might be, for example, out of a preference for privacy from search engine results, or the belief that the content of the selected directories might be misleading or irrelevant to the categorization of the site as a whole, or out of a desire that an application only operate on certain data.
Back to Tools Page
The robots exclusion standard, also known as the Robots Exclusion Protocol or robots.txt protocol is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is, otherwise, publicly viewable. Robots are often used by search engines to categorize and archive web sites, or by webmasters to proofread source code. A robots.txt file on a website will function as a request that specified robots ignore specified files or directories in their search. This might be, for example, out of a preference for privacy from search engine results, or the belief that the content of the selected directories might be misleading or irrelevant to the categorization of the site as a whole, or out of a desire that an application only operate on certain data.
Back to Tools Page
Home | About Us | Portfolio | Rates | Privacy Policy | Terms & Conditions | Registrations
Page Load:
Online 9:00 AM - 5:00 PM - Philippine Time
Standard time zone: UTC/GMT +8 hours