I'm not familiar with the PS4 and what inputs it has, but I would recommend a USB interface to run your mic through. It will allow for the best quality audio on your PC, but unfortunately I don't know much about the PS4 so you would need to look up to see if it would work for that. If your budget allows, you could always get a Zoom portable interface/recorder as it can run through USB to your computer and through a "line out" (standard 3.5mm audio jack) to the PS4. You may also be able to use a mixer for the same purpose, but look into what you need/have the budget for before you buy.
The products I linked are just starting points to help you out, but should fill your needs if you decide to go with one of them. Good luck, and I hope you can get everything running smoothly!
A couple of suggestions. First, don't get the atr2100 mics. You're paying for a USB interface you won't use. Pick up a couple of Shure SM58 mics - even if you upgrade later you'll have them as good quality spares. They cost a little more but they're a little better quality.
Get the Zoom H5. It's about $270 and had actual gain knobs (no digging through menus) and supports Zoom's interchangeable mic capsules. It can also act as an audio interface.
That'll leave you around $130 to pick up an inexpensive set of headphones, a couple of mic stands, and cords. You'll have a setup that will work well as a portable setup as well as an in-studio rig and will be useful later on if/when you decide to upgrade work a mixer or dedicated audio interface.