If the (gummy) silicon implant can get mold on it in the body can you get sick from it ?

Outside of immunocompromised populations (HIV and cancer patients), fungal infections are of very little concern.I am unaware of any documented risk of mold and silicone gel breast implants.There is a great deal of unsubstantiated myth peddled on the internet. Physician scientists may recognize anecdotal data but unless it is supported by Class I empiric data, it is difficult to place a great deal of faith in it. Clinicians should make decisions based upon evidence based medicine as this is the best tool we have to evaluate new and emerging treatments and technologies. Any claim can be made about anything, but unless verified it is difficult to put too great a degree of stock in it. 
That being said, it is easier to identify what one knows rather than what one doesn't. What we do know is that by all available measures today...implants are safe and specifically silicone implants are safe.
Silicone breast implants are among the safest medical devices in use today. These devices are also among the most rigorously studied and tested medical devices currently being used in the U.S. today. It is biologically inert and in that respect no different than the titanium used for bony fixation. More importantly, implants are placed in a sterile fashion, if they were harboring "mold" it is unlikely that anyone would be asymptomatic for any length of time. A fungal infection necessitate removal.
As always, discuss your concerns with a board certified plastic surgeon (ABPS).
Donovan Rosas MD
Board Certified by the American Board of Plastic Surgery
Member: American Society for Aesthetic Plastic Surgery, American Society of Plastic Surgeons
RealSelf Top 100
RealSelf Hall of Fame

Thank you for sharing your question.  I have never seen mold or fungus around a breast implant.  

Dear Time4 me61,
there is very, very small chance of getting a fungal infection of breast implants. 
The two main types of implants are silicone and saline. The shell of the implants can be either textured (which reduces capsular contracture) or smooth. A textured implant sometimes requires a larger incision. The shape of the implant can be either round or tear drop shaped (gummy bear). Both have their advantages and disadvantages.The different types of implant offer different pros and cons. For instance, the pros of silicone implants are that they look and feel more natural and ripple less.On the other hand, the pros of saline implants are that they do not require as large of an incision as silicone, less expensive, they have less incidence of capsular contracture (scarring around the implant), one can tell immediately if there is a rupture, the size can be slightly adjusted, and they can be used for women less than 22 years of age.
Daniel Barrett, MD
Certified, American Board of Plastic Surgery
Member, American Society of Plastic Surgery
Member, American Society of Aesthetic Plastic Surgery

I am aware of concern over mold forming in implants, primarily saline implants. However I have never actually seen it even heard of a case where this actually happened. To me that means it is a very rare occurrence.

I have not seen an implant or implant pocket culture fungus, but it is possible.  Fungal infections tend to be more common in immunocompromised patients, like those with diabetes or HIV.  In general, infections are very rare.  I have not gone back in to remove implants after about 1000 or so breast augmentations.  So to go back in for a fungal infection in an immunocompetent individual would be even more rare. But, if you are considering SALINE implants, ask your surgeon whether he or she uses a closed technique to fill the implants.