Delete comment from: Google Operating System

burtonator said...

Yeah... we do the same thing with Spinn3r. We have our crawlers reprioritize based on ping traffic and other variables.

Kevin

Jul 30, 2007, 9:27:00 PM

Posted to Google Indexing Many Web Pages in Real-Time