Another vote for baffles. This is the one I just added to my Bird Buddy feeder, which is mounted on a pole. The spicy seed mix didn't deter them, but the spicy suet seems to.
https://www.amazon.com/dp/B0BW58RGH7?psc=1&ref=ppx_yo2ov_dt_b_product_details