All people have facial assymmetry, however severe assymmetry can be syndroms such as hemifacial microsomia. Since you seem to have a trait that runs in your family, it is probably a good idea to be evaluated by a genetic dysmorphologist. This is a person whom specializes in genetics traits. Discuss your concern with your primary care doctor who can then refer you to the appropriate doctor. Best to you.