It is best to see a dermatologist for evaluation and treatment of this possible cyst. Your doctor may prescribe a round of antibiotics and a short course of oral steroids to treat the infection and decrease the inflammation in the cyst. Unfortunately, the only definitive treatment for a cyst is a surgical removal. Until the sac surrounding the cyst is removed, there is always a chance the cyst will recur. Due to the location, you may be referred to a plastic surgeon to perform the removal.