15: Crawling Wikipedia

Last updated
Save as PDF

Page ID: 12826

Contributed by Allen B. Downey
Professor (Computer Science) at Olin College
Sourced from Green Tea Press

In this chapter, I present a solution to the previous exercise and analyze the performance of Web indexing algorithms. Then we build a simple Web crawler.

15.1: The Redis-backed indexer
15.2: Analysis of lookup
15.3: Analysis of indexing
15.4: Graph traversal
15.5: Exercise 12