I have very soft water and high alkalinity.?

I need to lower the alkalinity without further lowering the softness of the water, it's already to the point that I should be ADDING ions. Will peat moss do the trick?