Aug 1, 2008
According to Google Blog number of Web URL's Google crawler indexes has crossed 1,000,000,000,000 mark from just 20 million and 1 billion in 1998 and 2000 respectively.According to Google they have come long way and their crawl techniques are unique "We don't index every one of those trillion pages -- many of them are similar to each other, or represent auto-generated content similar to the calendar example that isn't very useful to searchers. But we're proud to have the most comprehensive index of any search engine, and our goal always has been to index all the world's data"