Graph Structure In The Web

This document summarizes experiments analyzing the graph structure of the web using two large web crawls containing over 200 million pages and 1.5 billion links. The analysis found: 1) Degree distributions follow a power law, confirming previous studies. 2) The web forms a single connected component, but breaks into four distinct pieces - a central core (strongly connected component), pages that can reach but not be reached from the core (IN), pages that can be reached from but not reach the core (OUT), and disconnected tendrils. 3) The diameter of the core is at least 28 and the diameter of the whole graph is over 500, suggesting the web is not a "small world".