Having removed many old ruptured silicone implants I can attest that very small amounts of silicone are often left behind in spite of my best efforts to remove every last bit.
I have yet to see a patient return with problems, granulomas or otherwise and they are always thankful to have new, usually more aesthetically pleasing implants which are soft.
Often ruptures, which extend outside the natural scar layer which forms around the implant (extracapsular) are associated with hardening of the implants (capsular contracture) and this problem is solved at the same time.
There is no harm to your overall system from this tiny amount of silicone. Of course, if you look on the Internet long enough you will find an uninformed or clearly biased web site that claims they will make you sick. Steer clear of these since their rants are not scientifically based and usually just unsubstantiated assumptions (or worse someone trying to profit by inspiring fear).