About the data
Where the numbers come from
- Links
- The Common Crawl domain-level web graph (release cc-main-2026-jul-aug-sep): about 133 million domains and the links between them. A link means at least one page on the source domain links to the target domain. Counts are referring domains, not individual pages.
- Authority score
- 0–100 on a log scale from the domain's harmonic-centrality position in that graph. Harmonic centrality measures how few clicks the rest of the web needs to reach a site, so a cluster of sites linking to each other gains little. 100 is the most central domain on the web.
- PageRank position
- From the same graph, shown for comparison.
- Popularity lists
- Cisco Umbrella (DNS lookups, so it includes apps and devices, not just browsing), Tranco (a research ranking that averages several lists) and Majestic Million (by linking subnets, with the previous value for trend). If a domain is not in the top million of a list it is shown as “not listed”.
- Traffic estimate
- Based on the Chrome UX Report (CrUX): Google publishes, every month, which sites Chrome users visit most, in order-of-magnitude buckets (top 1,000, 5,000, 10,000 … 1 million) worldwide and for each country. Those positions are measured. The visits-per-month range is our rough conversion of the position and is labelled measured bucket. Sites outside Chrome's lists get an estimated range from the other popularity lists or their country positions, or a guess from links and authority when they are too small for any list.
- History
- Pages captured for the domain in one Common Crawl crawl per year from 2014 to 2025, plus the 2026 crawls; “OK” pages returned HTTP 200. Main language is the most common detected language of those pages.
- Live checks
- DNS records, registration data from RDAP and the current homepage, checked when the report is first built and refreshed after 24 hours.
Limits
Common Crawl does not visit every page on the web, so small or new sites can have fewer links here than in commercial indexes, and pages blocked to crawlers are invisible. The graph is a snapshot refreshed each quarter.
Free use: up to 5 new domains per day per visitor. Reports someone already looked up can be viewed any time.
Contact
Questions, corrections, data requests or bulk access: info@linguanet.net