Professionals Guide to Web Search frustrations...
Spidering (index creation)
- HTML content (no controlled vocabulary)
- Index can never really synchronous with the Web.
- Can never index ALL of the web.
Web content frustrations
- Not all content is from reputable sources
- Spammers try to subvert search rankings
- Consumers typically search for general concepts