HostProbe is expanding beyond Finland
More than 17.5 million domains across Estonia, Latvia, Lithuania, Norway, Sweden, Denmark, Poland and Germany are entering the HostProbe probing pipeline.
HostProbe Team
Project update
1 min read
HostProbe started with Finland.
Our current database is built around the .fi domain space, but that was always intended to be the beginning rather than the destination.
Over the past few days, we have been building the next batch of the HostProbe domain universe. We have now identified more than 17.5 million domains across Estonia, Latvia, Lithuania, Sweden, Norway, Denmark, Poland and Germany.
The current datasets contain:
- Estonia
.ee— 116,443 domains - Latvia
.lv— 102,247 domains - Lithuania
.lt— 177,780 domains - Norway
.no— 386,354 domains - Sweden
.se— 921,904 domains - Denmark
.dk— 1,256,529 domains - Poland
.pl— 2,477,240 domains - Germany
.de— 12,131,292 domains
Total: 17,569,789 domains.
Finding the domains is only the first step.
Before a domain becomes useful HostProbe data, we need to probe and process it: resolving DNS, identifying infrastructure and checking what is actually responding on the Internet. Millions of domains also means millions of failed lookups, dead hosts, redirects, timeouts and other wonderfully messy pieces of the real Internet.
That processing has now started.
During the upcoming days, these new country datasets will progressively make their way through our probing pipeline and into the HostProbe database alongside .fi.
We are not waiting for the entire batch to finish before moving forward. Our intention is to expose new data progressively as it becomes available.
This is an early step toward the much larger goal behind HostProbe: building a continuously updated view of the domain and hosting infrastructure we can observe across the Internet.
17.5 million new domains are waiting in line.
The probes are running.