I have 4Mbits and I very rarely feel the need for more. Even for large isos. But I don't use it for TV and phone at the same time.

If you're really motivated you can make a tiny proxy too, too improve DNS and HTTP response times, caching stuff and filtering ads at the network level.