If I don't wear my retainer will my teeth shift and bring back my previous face?

I will be taking off braces in 2 weeks (2 months earlier) as braces ruin my face, i aged, sunken cheekbone (severe, looks like skeleton). I wanted to ask if I am not wearing retainer will it bring back my previous face (at lease close to, more fuller I hope). i dont have any extraction but lined up teeth, closes some gaps. I hope if i am not wearing retainer may at least shift back my teeth to where they were. Thanks!