These boost converters are cheap and good for up to 5A.

You can't power the LEDs at 3.7 volts. They won't be dimmer, they just won't work.