Not my experience. You are right that it's less of an issue. But I very definitely stressed about individual matches and how it affects the ranking and stats. You hold it in until the match finishes and just don't join the next one right away but you still change your behavior. Or in something like WoW PvP servers you go somewhere safe before logging out etc.
What I dislike is how much more uncommon random matchups are. I find ranked stressful because it incentivizes making the number go up, so I prefer to be an eternal Quick Play player. But a lot of QP systems still use shadow rankings that influence who you get paired with, and they tend to give me very ping-pong results.
One game I'm dominating against the other team, but then the ball hits the other side and get paired with people above my level for the next several. It kinda makes me feel like the agency on how well I can perform is taken away from me, and I just have to hope the matchmaking system takes pity.
At least when matches were more random, sometimes I'd get paired with people above my level, but it was rare that it felt completely rigged against me.
...team pvp or even coop games need much more commitment.