Do you really feel comfortable judging like that. You have no idea about their wishes.

Using that as an argument for not having children is beyond silly.

Just say that you don't want children, it's ok, you don't have to make up reasons and try and convince others.

I think you're missing out on something amazing, but that's just my personal opinion.