The wife and I on our last trip bought a filter on Amazon Prime and had it delivered there before we arrived. I think it was $20 and we just left it there when we left. We were there for 9 days so it was nice to come back to cold filtered water at night, and ready for the morning when we headed out. Fit perfectly in the mini fridge as well.

Something like this