Jeremy J Lilley

US Patent:

8032518, Oct 4, 2011

Filed:

Sep 4, 2009

Appl. No.:

12/554757

Inventors:

Vanessa Fox - Redmond WA, US
Amanda Ann Camp - Kirkland WA, US
Maximilian Ibel - Pfaeffikon, CH
Patrik Rene Celeste Reali - Zurich, CH
Jeremy J. Lilley - Mountain View CA, US
Katherine Jane Lai - Cambridge MA, US
Ted J. Bonkenburg - Mountain View CA, US
Neal Douglas Cardwell - San Francisco CA, US

Assignee:

Google Inc. - Mountain View CA

International Classification:

G06F 17/30

US Classification:

707713, 709225

Abstract:

Web crawlers crawl websites to access documents of the website for purposes of indexing the documents for search engines. The web crawlers crawl a specified website at a crawl rate that is based on multiple factors. One of the factors is a pre-set crawl rate limit. According to certain embodiments, an owner for a specified website is enabled to modify the crawl rate limit for the specified website when one or more pre-set criteria are met.

US Patent:

8458163, Jun 4, 2013

Filed:

Oct 3, 2011

Appl. No.:

13/252149

Inventors:

Vanessa Fox - Redmond WA, US
Amanda Ann Camp - Kirkland WA, US
Maximilian Ibel - Pfaeffikon, CH
Patrik Rene Celeste Reali - Zurich, CH
Jeremy J. Lilley - Mountain View CA, US
Katherine Jane Lai - Cambridge MA, US
Ted J. Bonkenburg - Mountain View CA, US
Neal Douglas Cardwell - San Francisco CA, US

Assignee:

Google Inc. - Mountain View CA

International Classification:

G06F 17/30

US Classification:

707709, 707E17108, 707802, 709224, 709226

Abstract:

Web crawlers crawl websites to access documents of the website for purposes of indexing the documents for search engines. The web crawlers crawl a specified website at a crawl rate that is based on multiple factors. One of the factors is a pre-set crawl rate limit. According to certain embodiments, an owner for a specified website is enabled to modify the crawl rate limit for the specified website when one or more pre-set criteria are met.

US Patent:

7599920, Oct 6, 2009

Filed:

Oct 12, 2006

Appl. No.:

11/549075

Inventors:

Vanessa Fox - Redmond WA, US
Amanda Ann Camp - Kirkland WA, US
Maximilian Ibel - Pfaeffikon, CH
Patrik Rene Celeste Reali - Zurich, CH
Jeremy J. Lilley - Mountain View CA, US
Katherine Jane Lai - Cambridge MA, US
Ted J. Bonkenburg - Mountain View CA, US
Neal Douglas Cardwell - San Francisco CA, US

Assignee:

Google Inc. - Mountain View CA

International Classification:

G06F 17/30

US Classification:

707 3, 709224

Abstract:

Web crawlers crawl websites to access documents of the website for purposes of indexing the documents for search engines. The web crawlers crawl a specified website at a crawl rate that is based on multiple factors. One of the factors is a pre-set crawl rate limit. According to certain embodiments, an owner for a specified website is enabled to modify the crawl rate limit for the specified website when one or more pre-set criteria are met.