Sounds like a duel with a knight, so "sir" feels appropriate.

More seriously, I think it's possible that "sir" can be used in a way that casts everyone as equals. Like, you can be in a crackhead's den and recognize that he is in important person in that environment.