Yeah, you won't use that cable modem, just their fiber jack. Your router is ok, but just ok. If you want excellent speeds then yes, get a WiFi 6 router.
A couple of options that are mid range there is of course much more high end ones:
Nighthawk
Archer