Body Rejection to Contact Lenses Vs. Rejection of Breast Implants?

I am not aware of an association or correlation between these two entities. First off, although the body may develop silicone antibodies, a true allergic reaction is very rare.

Breast implants do not get rejected.  They are inert and should be no problem to insert.  Good luck with your decision.

I am NOT an eye specialist, so I cannot comment on your experience with contact lenses EXCEPT to say that it is VERY unusual.
Let me explain.
The word REJECTION is thrown around casually by the public and is permitted and tolerated by doctors who do not have enough time to correct this misuse of the term.
A REJECTION is a cellular and hormonal reaction in which a immunologically healthy body recognizes a GRAFT as being FOREIGN and attacks it with both cells and hormonal factors. Eventually, the blood vessels around the graft clot, the graft (if previously vascularized - dies and scar tissue is placed around it to wall it off from the rest of the body.
For example, if we were to transplant a kidney between one person and another who did NOT share ANY common immune markers, if the kidney recipient's immune system was not chemically suppressed, his/her body would recognize the new kidney was not theirs and attack it leading to graft loss.
A REJECTION reaction DOES NOT OCCUR with implants that do not bear immunological markers. In other words, knee joints, mechanical heart valves, implantable lenses, breast implants and even contact lenses DO NOT HAVE those markers that cause such reactions and therefore do NOT have classical rejection reaction that require on-going immunosuppressive treatments,
If I had to guess, I think you had a really bad eye infection associated with your contacts rather than a CLASSICAL rejection reaction.
The odds that your body would "reject" your breast implants is ZERO. The chances that they may become infected may reach 2%. Some would have to be removed if this cannot be treated. The odds that your breast implants may be associated with scarring - capsular contracture - during the course of their life time may be as high as 15% depending on the implants, the surgical technique used and how any existing infections (urinary tract etc) were handled.
In MY opinion, I see no reason why your bad contact experience and allergies should preclude you from having a good experience with breast implants.
Good Luck.