> Isn't this kind of feedback loop precisely what's predicted at the heart of the Singularity? A machine learning system reaching the point where it's able to improve itself without further human guidance?
Yes, but the article then goes on to explain that this isn't it.
> (As an aside, is there a theoretical limit to how intelligent a system can be for a given quantity of training data? Of course, we'd need a rigorous definition of 'intelligence' and 'data'...)
There is. A given amount of 'evidence' can only support a given amount of conclusions drawn. However, that absolute limit is mostly theoretical; it's completely astronomical compared to what humans manage, let alone AIs.
Yes, but the article then goes on to explain that this isn't it.
> (As an aside, is there a theoretical limit to how intelligent a system can be for a given quantity of training data? Of course, we'd need a rigorous definition of 'intelligence' and 'data'...)
There is. A given amount of 'evidence' can only support a given amount of conclusions drawn. However, that absolute limit is mostly theoretical; it's completely astronomical compared to what humans manage, let alone AIs.