Honestly, I appreciated "you" at my last job - I don't have kids, but work is not my life either, especially if I have to be in the office. I worked at a place where it was awkward to leave before 6:30pm, and the one person who always left around then was the guy with kids.