Should I seek a second opinion, have this shaved off or leave it alone? (Photo)

If your dermatologist has determined this is a benign skin lesion, you could consider removal for cosmetic purposes.  Your dermatologist is correct that excision will leave a scar but it may be possible to hide the scar to make it minimally perceptible.  Make sure to consult with a board-certified plastic surgeon for best recommendations.  Good luck!

Thanks for your questions and your one posted photo. You need to see an expert in cosmetic mole removal who is experienced in removing growths from the face. There is always a risk for scar, recurrence, pigment changes (darker/lighter/red) in the area treated, and possible need for additional procedures. But an expert should be able to remove your mole with minimal scarring and an appearance more pleasing than the mole currently. Importantly, my patients find that if a mole becomes flat, rather than raised, even a small scar can be easily concealed with make-up. Always you need to be diligent about avoiding the sun / proper use of sunblock for about 6 months after removal for the best results. 
Please seek out a board certified, fellowship trained Oculofacial Plastic Surgeon or other doctor with extensive expertise in cosmetic facial mole/growth removal.  I have had patients travel from around the country (USA) to have me treat them for this kind of challenging removal - especially after they were turned away by dermatologists, general plastic surgeons, and family doctors. My coordinators can conveniently arrange such a visit.  I have removed thousands of moles from around people's faces throughout my career and each presents its own challenges, risks for scar, etc. You can review my photos to explore your options -- all my results shown are unretouched, unphotoshopped photos!
Best of luck in your search.
Damon B. Chandler, MD
Harvard-Penn Trained Oculofacial Plastic Surgeon