My brother, I had been fighting that same problem for YEARS. It was a nightmare. I switched to a double edge safety razor and that helped. But what finally solved the problem for me is exfoliation.

I bought one of these and use it religiously every day. It took a little while but I can honestly say I haven't had the problem in a few years.

I also use a scrub brush on my beard in the shower.