Is There Long Term Damage Done when Skipping 5 Invisalign Trays?

I'm a 27 year old woman who has never had braces in the past. I'm currently doing the Invisalign treatment. I've completed trays 1-6 wearing each tray for 2 weeks. When I went to get set 7 from my dentist, he accidentally gave me set 12 which I've now been wearing for 4 weeks without knowing it was the wrong set. I've obviously been in a lot of pain for the past 4 weeks and they still don't fit flush down onto my teeth. What damage has most likely been done with this unnecessary rapid movement?