I feel you. My interest in video games is what led me to getting into computers and becoming the software developer I am today. But the fact is, as you said, it takes away from other things including relationships. In low doses is probably fine, but the risk is that you are kidding yourself about how much time you actually spend. If you really can manage low doses, good for you! But many of us end up spending more time than we care to admit, and that is when it is a problem. Although, as you raise your standards for how your time should be spent, even 1 hour a day of video games might sound like a lot. You could be building relationships, or reading great literature for example.
For me personally, it works best if I cut video games out completely.
For me personally, it works best if I cut video games out completely.