Can a change in hormones during pregnancy cause lipomas to grow or multiply?

I have at least 30-60 lipomas in my small bowel and colon. My husband and I would like to try to have a baby and my doctor has said that medically she can't tell me that I cannot because of lipomas. She has said that it is extremely risky but possible if monitored well. However, I read that some women develop lipomas during pregnancy or the current ones grow. Is there a connection between the two things? If there is a link, it would make things more complicated for me. Thank you for your help!