http://microformats.org/wiki/api.php?action=feedcontributions&feedformat=atom&user=Sj8Sqz
Microformats Wiki - User contributions [en]
2026-05-25T05:20:38Z
User contributions
MediaWiki 1.38.4
http://microformats.org/wiki/index.php?title=robots-exclusion&diff=17891
robots-exclusion
2007-06-24T04:26:57Z
<p>Sj8Sqz: </p>
<hr />
<div>= Robot Exclusion Profile =<br />
__TOC__<br />
== Draft Specification 2005-06-18 ==<br />
<br />
=== Authors ===<br />
* [http://peterjanes.ca/ Peter Janes]<br />
<br />
=== Copyright ===<br />
This specification is © 2004-2005 by the author. However, the author intends to submit this specification to a standards body with a liberal copyright/licensing policy such as the [http://gmpg.org/ GMPG]. See the [http://gmpg.org/principles GMPG Principles] for more details. Anyone wishing to contribute to this effort MUST read those principles, especially those regarding copyright and licensing, and agree to them before contributing.<br />
<br />
=== Patents ===<br />
The author neither holds nor intends to apply for any patents on anything required to implement this specification.<br />
<br />
== Abstract ==<br />
The Robot Exclusion Profile is a reworking of the Robots META tag (and less-standard extensions) as a [[microformat]].<br />
<br />
== Introduction ==<br />
The [http://www.robotstxt.org/wc/meta-user.html Robots META tag] is used to provide page-specific direction for web crawlers. While being useful in many cases, its page-specific nature means it cannot be used to restrict crawlers from indexing only certain sections of a document. Several attempts have been made to create more granular solutions through various methods but have perceived shortcomings that limit their use; the Robot Exclusion Profile defines a microformat that can be applied to any element or set of elements in a page.<br />
<br />
Like other microformats such as [[hcalendar|hCalendar]], the Robot Exclusion Profile defines a set of class names that may be applied to (X)HTML elements. <code>class</code> can be applied to almost every (X)HTML element, which means that authors may be as specific or general as they wish in their application. This differs from the similarly-purposed <code>rel="nofollow"</code> attribute, which may only be applied to (and does not refer to the content of) a specific inline link. (It is interesting to note that this behaviour is entirely encompassed by the use of <code>class="robots-nofollow"</code> on the same element.) Classes are also additive, so multiple values can be specified at once, e.g. <code>class="robots-nofollow robots-noindex"</code>. For robot exclusion in particular, this allows authors to specify multiple rules for an element without adding unnecessary extra markup.<br />
<br />
== Format ==<br />
=== Profile URI ===<br />
<code><nowiki>http://example.org/xmdp/robots-profile#</nowiki></code> (obviously preliminary)<br />
<br />
The classes defined by the Robot Exclusion Profile should be considered meaningless when the profile URI is not present in the document <code></div>
Sj8Sqz