How Big Should the Lipoma Be for Surgery to Take Place?

In general. lipomas do not need to be removed if you know they are lipomas. The problem is we do not know if they are lipomas until we biopsy them, Rarely lipomas can be malignant (liposarcoma) but this is exceptionally rare.
In certain instances, lipomas may cause symtoms due to their growth. This can cause pain , discomfort, or obstructive problems. They may need to be removed for these reasons.
In your instance, you may want to remove one or more to establish a definitive diagnosis.

The word TUMOR means SWELLING in Greek.
A tissue swelling (tumor) can be BENIGN (OK) or MALIGNANT (cancerous). Although the appearance usually suggests the diagnosis, it can never 100% of the time accurately predict it. A history of fast growth, ulceration, irregular borders, bleeding, crusting etc, SUGGESTS (not predicts) that a swelling may be malignant. But the ONLY way to know what "it" is is to get a tissue sample out and have a PATHOLOGIST look at it under a microscope.
The odds are that you have a familial syndrome associated with fatty tumor growth. But, in very rare cases, these may mascarade as such and could be cancerous. The only way to know is to biopsy them EITHER by removal or by getting a liver of tissue out.
MEDICARE allows removal of tumors which block essential orifices (eyes, nose, ears, moth etc), which bleed and which have other aspects of cancers. In your case, I would suggest you consider removing the large ellbow one before it deforms the elbow further and see what it is.
Good Luck.