You can play quite soft with an accordion. It is also good for your bellow's control.
Remember that the player hears less than the audience. Go and sit in front of the (closed) window, so you will get the sound back.
Be glad that you don't play bagpipes. Them cannot be played soft. I know, I play a French one and though they are much softer than the Schottish ones, my neighbour 500 meters away can hear it. (when played outside, of course)
I try to play the accordion every day and my wife and children don't like it every day.
But I'm still married and the children didn't leave there parents.
But the people next door love it.
Even in the beginning when I'm only playing simple scales and errors.
It's a problem every accordionplayer has to live with.
I'm also playing a little banjo, but that was allways allright.
And don't mute it!!!