I would wait until all wounds are fully healed, and at least 3 weeks after surgery to prevent internal bleeding by the increase in blood pressure and heart rate associated with exercise. Keep in mind that exercise will increase the swelling that you will have, just like any increase in activity.
In general, we recommend waiting six weeks after breast reduction before swimming or any other strenuous activity.The wounds need to be fully healed first. Better safe than sorry!