My doctor plans to remove my bandages after 3 days, instead of 4 days. Will this be too soon?

I do not think it would affect or harm your outcome, the time a surgeon recommends for bandages or in general compression garments varies with each surgeon depending on what he has seen works for the patients and all around knowledge, either way I do not think you surgeon would risk doing anything to harm your surgery so you should be fine.

    Bandages after otoplasty may have no impact on healing or development of hematoma.  However, every plastic surgeon will have a different methodology.  Kenneth Hughes, MD ear pinning Los Angeles, CA

There may be some variation from doctor to doctor in how long they prefer to leave on bandages after otoplasty.  Personally, I like to leave them on for three days, so I think you'll be fine having yours removed after three days (even though your surgeon normally leaves them on for four days).  Like your surgeon, I also recommend using a lighter type of bandage/compression after the initial bandage is removed.  

Bandages after otoplasty are highly personal sugeon preference. I know I give my patients differing lengths of bandage time depending on how much resistance the ears offered to reshaping.

 

One thing to keep in mind - you and your surgeon have the same definition of success (happy patient). I would trust that he won't risk success for convenience, and he feels comfortable with the duration of bandages.