Afraid to sleep on my ears almost three years after otoplasty - is it safe to sleep on them?

I was teased by my peers throughout my entire childhood because of my protruding ears, and I finally managed to afford otoplasty at the age of 30. The whole recovery was painful—one of the most painful things I had experienced up to that point. Because of the level of pain and the fear that my ears might go back to their previous position, I started sleeping on a travel neck pillow with a hole. Since I like sleeping on my side, it gradually became a habit. For the past three years, I’ve been sleeping with my head and the top part of my ear resting on the travel pillow, while the middle part of the ear stays in the hole.After three years, I want to correct this and start sleeping on my ears and on a normal pillow again. I’m wondering if my ears will be able to get used to pressure again since so much time has passed, and whether I should slowly reintroduce lying on my ears by increasing the time a few minutes each day? Did I create a permanent problem for myself?