Another possibility, if you know you will have a tap in your room, is to get a filter that attaches to the tap directly, such as this one (not a recommendation, just from a quick search for "faucet filter" - there are many brands/models). That will also have the advantage of filtering cold water when you want it as well :)

There's ones that attach to the faucet