> There's many occasions where I don't want to drink, but not doing so can make things uncomfortable.

People don't care as much if/what others drink as you think.