you can purchase several types of foam pads that are made for all sizes of mattresses. You can buy one that will help make your soft mattress a little firmer.
I would see if I could add something to make it more firm. Could you put an eggshell layer on top? Or maybe even put a hard board on top of the soft mattress and then a fluffy mattress on top of the hard board. Or sleep on the floor.