There's already a silicone filter holder
This one is a little more durable and packable.
I use one of these