Yes. You want a "pole mount bracket" that straps to the pole. I've tried using exhaust clamps and other U-bolts with the wedges, and it's not stable enough for my tastes.
This or something similar will probably work for you.