The only other meta tag possibly worth consider is the robots meta tag which is used to instruct the search engine spiders or crawlers on how to index, or how not to index the page. Without a robots meta tag, the default is "index, follow", which lets the search engine spiders assume that you want your page indexed by the search engine and to follow the links.
There are six attributes to the robots tag: index, follow, noindex, nofollow, all and none. Using the noindex, nofollow, index and follow tags there are four possible tags:
<meta name="robots" content="index, follow">
<meta name="robots" content="noindex,follow">
<meta name="robots" content="index, nofollow">
<meta name="robots" content="noindex, nofollow">
Index means that robots include this page in the search. Follow means that robots are follow links from the page to other pages. Noindex and nofollow have the opposite affect.
The "all" and "none" tags are to be used as follows:
<meta name="robots" content="all">
<meta name="robots" content="none">
"All" is the same as "index, follow" and. "None" is the same as "noindex, nofollow".
If you want a page indexed and the links followed, a robots meta tag is not needed. If there are parts of the site that you do not want crawled or indexed, the peferred standard is a robots.txt file, but it does no harm to also have the "noindex, nofollow" tag.
|