In the context of web design, it refers to design methods which discourage listing of sites or content in search engines by inhibiting "spiders" used by search sites.
See Steven Pemberton and original linux-elitists post.
Fact-index.com financially supports the Wikimedia Foundation. Displaying this page does not burden Wikipedia hardware resources. This article is from Wikipedia. All text is available under the terms of the GNU Free Documentation License.