How much does calculating the approx time of posting for every comment add to the total load?
If it’s significant then you could ship the UTC posting time to the client & calculate the displayed value in Javascript & eliminate that particular part of the load at least, which in turn might enable more caching internally.
The total number. We actually stop rendering comments past a certain amount of nesting; ever see a 'more' link where 'reply' would normally be? That's what that is.