I Can't Stand This Compression Garment Any Longer?

I am 5 days post op from smart lipo on my abs and flanks. I am slightly bruised on my back and vagina area, sore to only the touch, and swollen a bit. I have noticed that I am swollen to the size I was pre-op but nothing too big. This garment is more of a pain than anything else! It has rubbed my incision areas raw and is just uncomfortable. My dr said it was ok to remove it but I want to make sure that it wont have a negative effect on my final results.