Ingrown Hair Cyst Signs and Safe Removal Verywell HealthHair follicle growing inward is a common problem that women encounter on their genital area. Such occurrence can be irritating and can cause redness, itchiness, or tiny bumps. If you have an ingrown hair on your vulva, there are several approaches you can try to alleviate the pain and help in healing.