Small rivets in electronics are very easy to remove and replace. To remove them you gently drill them out with a 1/8th or 3/16ths drill bit, perform your fix then re-rivet the piece back into place.

You can get a rivet kit at most hardware stores. The rivet gun runs around $15-20, and a box of assorted rivets of common sizes is about $10.

Here is an example.

Once you get it off, send some pics of the driver so we can take a look at it.