Lipoma on Xiphoid Process - Is there an increased risk for removal?

I have a diagnosed Lipoma over my Xiphoid process. It has doubled in size in the past year or so. From what I can feel.. my guess is it's about 3.5cm x 3.5 cm and attached just under my right rib cage. I want it removed because it sticks out, I usually don't wear a bra d/t it putting pressure on my chest/stomach & it hurts when I stretch certain ways. I am wondering if there is increased risk of removal & pain/recovery due to the location? Would a General surgeon be a good choice? Thank you!