I'm having the exact same issue while connected to a Samsung A650 series sound bar.
- Change sound mode to 'surround sound' for my Nvidia Shield TV.
- Change input to PS5 or XBSX
- Observe sound mode is reverted to 'Game' mode for all inputs.