As has been mentioned I’ve always been nervous about breaking or bending the pins so I’ve just resigned myself to frequently losing and replacing cheap hollow rubber plugs. But if you wanted to make yours easier to remove, people who use them stuck one of these to them (might want to augment adhesive with glue):