I have something very similar to this one from Amazon. It's easy to attach and remove and the water bottle and cage stay in place.

https://www.amazon.com/zonkie-Bike-Bottle-Mounting-Black/dp/B08SBLPPZJ/ref=sr_1_37?crid=47UPNLQT13V8&keywords=bicycle+water+cage+mount&qid=1660681075&sprefix=bicycle+water+cage+mount%2Caps%2C129&sr=8-37