WebStatBot's goal: map what kind of business the internet is actually made of — company websites, blogs, online shops, real estate listings and more — across 11,583,008 domains in 32 European countries. Every chart here is live and free to download.
Download the dataPress & quotesContent management systems, shop platforms and the marketing stack detected on crawled domains.
Share of 5,460,934 sites with a recognised CMS
Online shops by platform
Share of all 11.58 M domains
Domains in the census by country, the languages they are written in and who they sell to.
32 countries
Most common site languages
Classified sites (422,439)
Which sectors sites belong to, where they are hosted and who runs their mail.
Classified sites by sector
Top networks hosting the sites
Mail servers behind the domains
These numbers are live. They come straight from the crawl database and refresh every hour — quote them, chart them, download them.
Source: WebStatBot web census, www.webstatbot.com, data as of 2026-11-13. Licensed CC BY 4.0.
Breakdowns by country, sector or platform on request: press@webstatbot.com.
Every chart on this page as a CSV file. Free, no sign-up, no API key, licensed CC BY 4.0 — just credit “WebStatBot”. Files are generated live from the same data you see above.
| Dataset | Rows | Size | |
|---|---|---|---|
| Domains by countryCSV | 32 | 630 B | Download |
| CMS and site buildersCSV | 15 | 230 B | Download |
| E-commerce platformsCSV | 18 | 330 B | Download |
| Marketing & analytics technologiesCSV | 10 | 332 B | Download |
| Site languagesCSV | 15 | 232 B | Download |
| IndustriesCSV | 21 | 459 B | Download |
| Hosting providers (top)CSV | 12 | 252 B | Download |
| E-mail providers (top)CSV | 10 | 207 B | Download |
| Domains by TLDCSV | 80 | 712 B | Download |
| Everything in one fileJSON | — | 14 KB | Open JSON |
Not just the counts above — full domain-level data, one row per domain (status, platform, industry, TLD, country, …). Free to download, licensed CC BY 4.0.
| Dataset | Rows | Size | |
|---|---|---|---|
| All domainsCSV.GZ Every domain in the catalogue with status, CMS, shop platform, industry, TLD, country and language. | 11,583,008 | 86.2 MB | Download |
| All domains (Parquet)PARQUET The same table as Parquet (zstd) — for DuckDB, pandas, Spark. | 11,583,008 | 101.8 MB | Download |
| Domains with a newsletter signupCSV.GZ Websites where the crawl found a newsletter signup form (form with an e-mail field and subscribe wording, or a known e-mail marketing provider), one row per domain. Extra columns: is_shop (1 = online shop) and crux_rank (Chrome UX Report popularity bucket, empty = not ranked). | 390,649 | 3.5 MB | Download |
| Domains — Media & contentCSV.GZ Websites classified as Media & content, one row per domain. | 36,044 | 270 KB | Download |
| Domains — Construction & craftsCSV.GZ Websites classified as Construction & crafts, one row per domain. | 33,438 | 223 KB | Download |
| Domains — E-commerceCSV.GZ Websites classified as E-commerce, one row per domain. | 26,005 | 185 KB | Download |
| Domains — Non-profit & public sectorCSV.GZ Websites classified as Non-profit & public sector, one row per domain. | 25,076 | 181 KB | Download |
| Domains — Sport & outdoorCSV.GZ Websites classified as Sport & outdoor, one row per domain. | 21,651 | 157 KB | Download |
| Domains — EducationCSV.GZ Websites classified as Education, one row per domain. | 21,613 | 152 KB | Download |
| Domains — TravelCSV.GZ Websites classified as Travel, one row per domain. | 19,375 | 141 KB | Download |
| Domains — Food & hospitalityCSV.GZ Websites classified as Food & hospitality, one row per domain. | 18,335 | 140 KB | Download |
| Domains — B2B servicesCSV.GZ Websites classified as B2B services, one row per domain. | 17,924 | 128 KB | Download |
| Domains — Manufacturing & industryCSV.GZ Websites classified as Manufacturing & industry, one row per domain. | 16,928 | 117 KB | Download |
| Domains — Health & beautyCSV.GZ Websites classified as Health & beauty, one row per domain. | 16,582 | 122 KB | Download |
| Domains — HealthcareCSV.GZ Websites classified as Healthcare, one row per domain. | 14,369 | 101 KB | Download |
| Domains — AutomotiveCSV.GZ Websites classified as Automotive, one row per domain. | 13,125 | 89 KB | Download |
| Domains — Home & gardenCSV.GZ Websites classified as Home & garden, one row per domain. | 12,881 | 91 KB | Download |
| Domains — Marketing & agenciesCSV.GZ Websites classified as Marketing & agencies, one row per domain. | 11,422 | 81 KB | Download |
| Domains — IT, software & SaaSCSV.GZ Websites classified as IT, software & SaaS, one row per domain. | 11,331 | 75 KB | Download |
| Domains — Real estateCSV.GZ Websites classified as Real estate, one row per domain. | 9,554 | 68 KB | Download |
| Domains — Finance & insuranceCSV.GZ Websites classified as Finance & insurance, one row per domain. | 7,976 | 57 KB | Download |
| Domains — Fashion & clothingCSV.GZ Websites classified as Fashion & clothing, one row per domain. | 7,018 | 51 KB | Download |
| Domains — Transport & logisticsCSV.GZ Websites classified as Transport & logistics, one row per domain. | 5,021 | 37 KB | Download |
| Domains — ElectronicsCSV.GZ Websites classified as Electronics, one row per domain. | 5,001 | 35 KB | Download |
| Domains — OtherCSV.GZ Websites classified as Other, one row per domain. | 71,770 | 471 KB | Download |
Four steps, no accounts, no personal data — the input is the open web, the output is a domain list you can download.
✓ No personal data collected ✓ Raw page content never stored ✓ Only aggregate stats & domain lists are published
We download Common Crawl's public web archive, plus other freely available public URL and domain lists (e.g. Tranco rank) to fill gaps — never anything that needs a login.
Pattern matching on the page itself: the CMS it's built with, shop-platform signals, marketing tags, and the structure and keywords that point to a business category — blog, shop, real estate listing, and so on.
A classified list of domains — by industry, CMS, platform, country, language — that you can download, plus the aggregate statistics on this page.
No. The page content itself is never stored — only a handful of classification attributes, and only as part of what's published here, free, under CC BY 4.0. Nothing is sold or forwarded to third parties.
No. webstatbot.com itself has no analytics, no cookies, no accounts and no tracking of any kind — nothing about you or your visit is kept. The only caching that happens is the published aggregate statistics themselves, refreshed hourly for speed.
We'd like to let volunteers contribute spare compute to crawling and classification, but that isn't built yet. If you'd like to help build it, or just want to hear when it opens up, email bot@webstatbot.com.
WebStatBot fetches public pages only. It never logs in, submits forms or places orders, and identifies itself as WebStatBot/1.0 (+https://www.webstatbot.com/bot).
Crawl-delay.429.Data is fetched just in time from public URLs, only for statistical analysis of domain, CMS, e-commerce, marketing tools and site language. The page is downloaded to read it once — the downloaded content itself is never stored, only the handful of extracted attributes, and only as part of the published aggregates. No personal data is collected, and nothing is forwarded or sold to third parties. Read the full terms of collection.
Add this to your robots.txt and WebStatBot stops visiting:
User-agent: WebStatBot
Disallow: /Read how the crawler behaves · Test it on your URL · Crawl your site for bad links