Can smoking marijuana while having Invisalign aligners off affect the treatment?

Hi my name is Jason. I have severe back problems and smoke medicinal marijuana to ease the pain because I don't like pain medicine and its side affects. I am about to have Invisalign aligners next week. If I take off the aligners during the short period of time that I smoke and brush / floss right after; can this affect the Invisalign treatment? Please advise, thank you.