Should the capsule also be removed when I have my implants taken out?

Leaving a capsule behind is preferred if it is thin and pliable. If there are calcific components, or silicone granulomatous material, or if the capsule is deforming the breast tissue, then removal of the capsule may be warranted.  A number of scientific studies have demonstrated the safety of silicone implants; yet, many patients continue to have anxiety about their use.
Kenneth Hughes, MD, Board Certified Plastic Surgeon
Los Angeles, CA

Thank you for the question.  
Generally speaking (in my opinion), unless the breast implant capsules have thickened (and/or are otherwise symptomatic),  are associated with the ruptured silicone gel breast implants, or if the patient has concerns about "medical conditions" related to the breast implants, capsulectomy is not universally necessary.  For these patients, en bloc removal of breast implants is a good procedure.
On the contrary, capsulectomy can expose you to additional risks, such as bleeding and minimal size loss.  In other words, any maneuver performed during surgery exposes patients to additional risk (morbidity).
 I hope this helps. Best wishes.