Mute button must be pressed twice

If I mute the sound on my Denon AVR 591 for more than just a few seconds, I have to press the mute button twice to get the volume back on. Is there a way to fix this?

Thanks