>> You fundamentally can't get back information that has been destroyed/or never captured in the first place.
> I love this cliché. I've seen it thousands of times, and probably written it myself a few times. We all repeat stuff like that ad nauseam, without ever thinking.
It is not a cliche it is an absolute truth. Information not present cannot be retrieved. There may be more information present than is immediately obvious.
> Neural Nets are excellent in squeezing all the information out noisy data
Maybe but they are also good at overfitting onto noisy data (the original article is an example of such overfitting).
> I love this cliché. I've seen it thousands of times, and probably written it myself a few times. We all repeat stuff like that ad nauseam, without ever thinking.
It is not a cliche it is an absolute truth. Information not present cannot be retrieved. There may be more information present than is immediately obvious.
> Neural Nets are excellent in squeezing all the information out noisy data
Maybe but they are also good at overfitting onto noisy data (the original article is an example of such overfitting).