If you have problems with ingrown hairs, there are a few things that you can do to help with this. The most important thing you can do is exfoliate. Using a brush, loofa, cloth or other exfoliating devices you will be able to remove any dead skin cells that may trap newly grow hair and cause painful ingrown hairs. Another thing you can do is ensure that your skin is always moisturized. Whenever you get your skin wet in the shower or swimming, be sure to apply a moisturizer afterwards.