Best to avoid cheap suitcases and all in ones. You have the budget for a better turntable with better playback and better speakers for good sound.

The AT-LP60X $105 adds a diamond tip stylus on an MM moving magnet cartridge connected to an RIAA phono preamp for better sound over the cheap suitcases and all in ones with cheap ceramic cartridges and cheap built in speakers.

Plus better $79 to $159 powered speakers with audio cable input for the turntable plus Bluetooth for streaming digital music:

Compact 4" mid bass driver speakers for a small room or a desktop setup:

• Bestian SR4 $85 has analog, digital optical and USB inputs.
• Edifier R1280DBs $159 $127 has 2 analog inputs, a digital optical input plus a subwoofer output.

Larger 5.25" mid bass driver speakers for a small to medium size room:

• Saiyin DS6801S $79 has analog and digital optical inputs plus a subwoofer output.
• Better 5.25" Neumi BSP5 $159 has analog and digital optical inputs.

Or what is a nearby town or zip code I can search for used speaker options? Reply here or chat.

Then later connect a CD or DVD/CD player you can often find at a thrift shop for under $25 and possibly a cassette deck too. Or even this $39 CD + Cassette player or $69 Sony that both have a headphone jack 3.5mm output to connect to the powered speakers with a 3.5mm to RCA cable. If you need more inputs for the powered speakers connect a $15 RCA switch.

Audio Guides, Speaker Placement, Accessories and Vinyl Care