You're looking for a "normally closed push button" switch for this situation.
Here's the first thing that came up searching Amazon https://www.amazon.com/DIYhz-Momentary-Button-Pushbutton-Switches/dp/B07YC7G5HL/ref=sr_1_1?hvadid=463593269989&hvdev=c&hvlocphy=9051682&hvnetw=g&hvqmt=e&hvrand=9563384306561578792&hvtargid=kwd-950331366662&hydadcr=16749_9852011&keywords=push+button+normally+closed+switch&qid=1686939374&sr=8-1