If you have a little patience, what I'd really suggest is this board from Kurokigoishiten, and these glass stones from Amazon. If you want, you may want to add bowls to your Kurokigoishiten order, YMI, or Amazon.
I really like my YMI Yunzi stones, but of course they cost a little more. There was some concern about lead contamination a few years ago you could probably look up, but as long as you wash your hands and don't put them in your mouth (both things you should be doing anyway) I don't think there's much to be worried about.
My very first set was something like this one from YMI. They have sales from time to time, and they'll sometimes have the same items on Amazon for a little cheaper (returns through Amazon are also simpler), but if you want a simple buying experience for "standard sized" equipment, this is probably it.
That said: Bamboo can be very heavy, so I'd avoid thicker boards made from such.
I'd also avoid YMI's shin (or "new") kaya boards, as a lot of people have had issues with the boards being warped or otherwise low quality. This was the case for me twice. I also don't care for how yellow their boards will look in person.
I also don't care for melamine stones. They are clearly plastic-y looking to me, and the circumferences are not always clean, many having a wavy kind of flak or something. Glass is in the same price range, and as long as you're not throwing or slamming the stones, you probably don't need to worry about chipping.
I prefer double convex stones; aesthetically, as well as not having to consider which way a stone is facing when placing—a concern that comes again with clamshell stones.
I'll add that some people like single convex for variations/study, but it's never been an issue for me. Single convex is also typically "Chinese sized", i.e. larger around and the boards likewise slightly larger. "Japanese sized" equipment is more common I think, and of course slightly smaller. If you have a "Japanese sized" board but "Chinese sized" stones (single convex), they might not quite fit on a board with a lot of plays. The other way around will leave spaces between the stones, &c. I'm not sure if YMI equipment follows these in all cases though.