Single stick is by far the least expensive way to get started.
A couple of these https://www.woodenswords.com/product_p/singlestick.blade.r.36.htm
Make baskets from a couple of 8 inch jolly balls https://www.amazon.com/dp/B09DLDSJVK/ref=cm_sw_r_cp_api_glt_fabc_DKQ0P7PE0TT783BPN122?psc=1
Free appropriate source for saber http://www.thearma.org/pdf/ColdSteel.pdf
Depending on shipping, your budget might be able to get you a pair of them, then you just need to find some fencing masks on Craigslist/Facebook marketplace and a willing partner.