I think it's a false dichotomy because there is more than two possible outcomes. At one end you have 'there is no god' in which case it doesn't matter, fine, but then at the other end there's more than just 'worship God' - there's also 'worship multiple Gods', or 'worship the devil', or endless other possibilities of worship, with no strong reason to pick any one of them.
I think the assumption is that you are considering believing in a Christian God and on those terms the wager is valid. As far as I know other religions offer little promises in terms of what happens if you stick with it.
I think category A would be believing in Jesus and category B would be not believing in Jesus whatever that means to you.
Unless I have misunderstood the Wager.