Dana, thanks for your input. But I'm not asking Google to share its secret sauce, which is its analysis/algorithm. All the robots are collecting the same open information - what's on a web site. Why duplicate that effort 20 times (on my site 20 robots visit daily using 45% of my bandwidth.)
A central open index could be collected by one "openbot" and accessible to any company. That should be cheaper than collecting all that data individually. The analysis of that data is where the secret sauce is.
The best of ZDNet, delivered
ZDNet Newsletters
Get the best of ZDNet delivered straight to your inbox
