That setting can be fairly sticky. Mine has stayed off since I initially disabled it, shortly after they added the "feature". I have no idea why it's not sticky for you. Maybe they fuck with me less because I have premium?
I don't have premium and it's sticky for me but only on a single computer, I have to reset it if I switch computers or browsers. Same with dark mode. So maybe it's stored as a cookie and they wipe their cookies?
Surely you don't expect YouTube, a company that doesn't store any data at all actually, to be able to store a single boolean value somewhere in your account, do you? This would be impossible for a company as broke and small as YouTube.