Handmade soaps often "sweat" in humid environment due to the high content of Glycerin which actively absorbs moisture from its surroundings.
So when it sits in a humid environment, the glycerin in the soap will draw the moisture from the air and onto the soap.
The best long term solution to...