I wear silicone nipple covers and a tank top with a built in bra if more support is needed. Same boat here. Also, getting Jockey Slip Shorts. They're amazing. Cheap. And allows you to wear dresses and skirts without the chafing.

https://www.amazon.com/dp/B001O482VU/ref=cm_sw_r_apan_i_Y3ZFXSXTJNY0H1Z93S2Z

https://m.jcpenney.com/p/jockey-skimmies-slip-shorts-2109/pp5002880715?pTmplType=regular&country=US&currency=USD&selectedSKUId=12390600273&selectedLotId=1239060&fromBag=true&utm_medium=cse&utm_source=google&utm_campaign=Slip%20Shorts&utm_content=12390600273&cid=cse%7Cgoogle%7CWomens%7cSlip%20Shorts_12390600273&kwid=productads-adType%5EPLA&gclid=Cj0KCQjwgMqSBhDCARIsAIIVN1Uv_HWGbkhhiYPkr8YIvI0AN-0SqMWDm8OQQV16Tm3h6gre5vomBUYaAhh2EALw_wcB&gclsrc=aw.ds