This might be an OS difference, but on Mac or Linux I can use a two finger swipe to go back. (I can also press with two fingers and move in order to trigger a mouse gesture, which other browsers do not have.)
According to Vivaldi this feature was added to the development pipeline in May of this year. It doesn't show as implemented. It hasn't worked on Windows or Linux for me as recently as last week.