Select the product you need help with
- Internet Explorer
- Windows Phone
- More products
FP: How to Use the META Element with Web Spiders and Robots
Article ID: 205493 - View products that this article applies to.
This article was previously published under Q205493
For a Microsoft FrontPage 98 version of this article, see 194310
For a Microsoft FrontPage 97 and earlier version of this article, see 170555
Web spiders (also called robots) are a great resource for people searching the Internet, but they present a problem to Web page designers who want their pages to be seen and properly indexed. One popular solution to this behavior is to use the Hypertext Markup Language (HTML) META element.
The META element is placed in the HEAD element to embed document meta-information that is not defined by other HEAD elements. This embedded information can be extracted by servers and clients to identify, index, and catalog specialized document meta-information.
META elements are added to the HEAD section of an HTML document, and can be written in one of two forms: META NAME and META HTTP-EQUIV.
The NAME or HTTP-EQUIV attribute declares a variable for the page and the CONTENT attribute assigns a value to the variable.
A META element standard for web spiders has evolved, which consists of two elements:
NOTE: Some web spiders ignore the Description attribute and use their own algorithm to generate a description of the page.
Description A brief description of the Web page. Keywords One or more words that refer to the content on a Web page.
Two examples using this standard are as follows:
For additional information about working with Web spiders and robots, click the article number below to view the article in the Microsoft Knowledge Base:
(http://support.microsoft.com/kb/217103/EN-US/ )How to Write a Robots.txt File