I think the solution would be headphones rather than speakers!

Or, set the output device to speakers, change the volume down, then set the output device to Multi-Output again.