You know those small LED lights that are about 3-4" in diameter and turn on and off just by pushing on it? They sell them at housewares stores for a few dollars each. Maybe one of those will work? Like https://smile.amazon.com/STAR-SPANGLED-Battery-Powered-Anywhere-Adhesive/dp/B07S8RWJ71/

Or you could use a group of the kinds of single LED lights that twist to turn on like https://smile.amazon.com/HOSL-Decoration-Lanterns-Balloons-Festival/dp/B00JSHX4S6/ . They come in different colors too if you're still looking for gauntlet lights (but may be too bulky for that purpose).