> Paintadosi [4] argues that one parameter is always enough. He constructed
a function that, through a single parameter, can depict any shape. However, in
essence, this work is a form of encoding, mapping the shape into a real number
with precision extending to hundreds or even thousands of decimal places. For
our problem, this is meaningless, although the paper’s theme is that “parameter
counting” fails as a measure of model complexity
The number of parameters is just the wrong metric, it should be the amount of information contained in the parameter values, their entropy, Kolmogorov complexity or something along that line.
> πfs is a revolutionary new file system that, instead of wasting space storing your data on your hard drive, stores your data in π! You'll never run out of space again - π holds every file that could possibly exist! They said 100% compression was impossible? You're looking at it!
