robots exclusion issues
These are externally raised issues about Robot Exclusion Profile with broadly varying degrees of merit. Thus some issues are REJECTED for a number of obvious reasons (but still documented here in case they are re-raised), and others contain longer discussions. Some issues may be ACCEPTED and perhaps cause changes or improved explanations in the spec.
IMPORTANT: Please read the robots exclusion FAQ before giving any feedback or raising any issues as your feedback/issues may already be resolved/answered.
Submitted issues may (and probably will) be edited and rewritten for better terseness, clarity, calmness, rationality, and as neutral a point of view as possible. Write your issues well. — Tantek
Resolved issues that have no further actions to take. These will likely be moved to a separate page like robots-exclusion-issues-closed.
- The "efficacy" and "collateral damage" issues from rel="nofollow" also apply.
Please use this format (copy and paste this to the end of the list to add your issues):
YYYY-MM-DD raised by
- Issue 1: Here is the first issue I have.
- Issue 2: Here is the second issue I have.