That sounds like you have a serious humidity problem where you live. You could try things like putting a silica packet from an older pill bottle in with it to soak up the moisture, or even make your own with a bit of thin fabric and rice.

Though is probably easier to just search for waterproof pill cases instead...