I'm pretty sure I have seen this or something very similar somewhere before but I can't remember where. It is pretty impressive.
The background map they use though for this is definitely wishful thinking in my area. I clicked on points that looked to be near me and discovered that the census data used for those points has people living on a couple of roads that haven't been built and won't be built for at least two years if things go like they have on the other road construction projects within a few miles of me. Today the roads only exist on planning documents posted by the city.
Highcharts has had a "boost" module for a long time (at least back since 2015/2016) that switched the rendering over to WebGL for large data sets, but I don't think it ever got up to 1B points.
Ideally, you'd embed the graph into 2 or 3d first, then visualize it as a scatterplot.
Visualizing the edges at scale doesnt yield nice results in general. It's simply too noisy.
The way to do it is to reduce the graph to some 300d or 500d embeddings, then use TSNE/UMAP/PACMAP to reduce that to 3d. Then visualize.
My prefered way is to use some first order embedding method like GGVec in this library [1] (disclaimer I wrote it). Node2Vec and ProNE don't yield great embeddings for visualization (the first is too filamented, the second too close to the unit ball).
Another great library to do this work is GRAPE [2]. Try first-order embedding methods, or short walks on second order methods to avoid the embeddings being too filamented by long random walk sampling.
I do find it funny when you have this glaringly bad bug that effects everyone and the bug template wants you to report everything down to your DNA. Sometimes it is nice to just report: latest released version, here's my stack trace...
Great tool to add to the visualization toolbox! It does seem to lack the visual fidelity at large scales that it resovles at finer ones. I wonder if it could extend to the render + raster approach of Datashaper, while still running everything in browser?
It seems I don't have the necessary graphics extensions available on my mobile device (mainstream device using mainstream browser). Is this supposed to work on mobile?
The background map they use though for this is definitely wishful thinking in my area. I clicked on points that looked to be near me and discovered that the census data used for those points has people living on a couple of roads that haven't been built and won't be built for at least two years if things go like they have on the other road construction projects within a few miles of me. Today the roads only exist on planning documents posted by the city.