Yes, the bass side tends not to work very well in those situations. You may find that on some parts of the chord progression you can get a little of the left hand in, and that is OK. Or, you can just leave it off entirely if it seems to clash too severely, which it will a good percentage of the time.
I actually brought this up with Mr. Elton Doucet of Richard, LA who builds his own "Cajun Accordion" brand.
What I'd like to see is basically a Cajun accordion (sibgle row, four stop diatonic) with a bass side that looks more like the ones on triple rows. That way we could get missing chords like F and D as well as some minor chords like Em, A, and Dm.