Small tear above earring, what to do?

I got my ear lobe pierced about seven weeks ago, more or less. Last night, I was awoken by soreness in my right piercing. I had been sleeping on it so I thought it may be normal. I decided to check anyway. Turns out, there's a tee tiny (less than a millimeter) above my piercing on the back of my lobe. I cleaned it with an anti-bacterial wipe( I know, I'm going get some hydrogen-peroxide today). Should I leave the piercing in or take it out and let it heal.