Google, Yahoo, the X-Robots directive and your website rankings
Google, Yahoo December 13th, 2007Last week, Yahoo announced that they now support the X-Robots-Tag in the HTTP header. This new tag allows you to influence how Google and Yahoo index your website pages.
What is the X-Robots-Tag?
Google introduced the new X-Robots-Tag directive in 2007 to allow webmasters to control access to non-web page documents, such as Adobe PDF files, video and audio files.
The X-Robots-Tag is included in the HTTP header of a document. The HTTP header is the initial reply of a server to a query. It contains information about the document that follows, including content type, creation date, character set, encodings, etc.
The new X-Robots-Tag allows webmasters to add information about search engine indexing to the HTTP header.
January 20th, 2010 at 2:10 pm
Well i was not aware of this information of X-Robots-Tag and now i will share
this information with my friends also and i will be keeping a close eye on your each new post.