My main gripe with handling music on jellyfin is that it expects your music to be stored in a certain folder structure[1] meaning it uses a kinda weird mix of metadata and folder structure to scan. This seems to be foundational so this probably won't get fixed in the near future (not because they like it this way, but because it's a lot of effort).

Not sure if you need some effort to "convert" your library to this structure.

[1] https://jellyfin.org/docs/general/server/media/music/#discs