Generally, exertional activity, like exercise and swimming should be avoided for 2 weeks after any nasal surgery. Chlorine can be irritating to the nasal lining tissue, so if you swim that early, it might sting a bit. If not, then you should be OK if you wait just 2 weeks Best of luck
It is acceptable to start getting back into the pool and swimming approximately two weeks after the surgery. Make sure you do not bump your nose on the bottom or side of the pool especially during the first month after the procedure.