You can, and should, do this! I buy reusable cotton tea-bag thingies from the place that rhymes with Hamazon, and use them for spicifying rice, or occasionally for actual strategic tea doctoring purposes.

Edited to add something actually useful ... the link: https://www.amazon.com/gp/product/B085PYJZDD/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&th=1