Eventually, it'll come loose, possibly shorting the drive, or the port. The drive will work, but with nothing to secure it in place, it will cause issues later. Your best bet would be to use an adapter. This is listed for a Mac, but is a generic adapter that should work with any NVMe drive, and a fix for under $10.