OP was right. No need to remove the 4 screws. I used the butt end of this tool to pry up the faceplate with no issues:

www.amazon.com/Original-iSesamo-genuine-Spudger-Opening/dp/B074MFG53R

I however noticed the thicker/wider 'stem' or 'stick' part of the Xbox thumbsticks prevented the full range of motion of the joystick. For example, in the steamVR settings I could only get to about 90% of the full range as compared to the stock thumbsticks, which may not really matter in game. However, I also had issues where the xbox thumbsticks would get stuck in diagonal positions for some reason, which was annoying. I tried sanding more and more to lower the sticks, but I think that had the reverse effect, since the sticks actually bottom out on the grey post of the joystick sensor when you put them on.

I had everything to do this mod already, so it was fun to try. I will be sticking with the stock thumbsticks however.