Can a punch in my nose distort it permanently?

It is very common after nasal trauma to have some swelling. Just give it 3 weeks or so to go down before evaluating its shape. You can massage it daily to help it heal in the middle as well. If a deformity persists, you can always have it corrected with surgery.

Hello and thank you for your question.  The
best advice you can receive is from an in-person consultation.  I
recommend that you seek consultation with a qualified board-certified plastic surgeon
who can evaluate you in person.
Best wishes and good luck.
Richard G. Reish, M.D.
Harvard-trained plastic surgeon

Nasal fractures are best determined during a history and physical examination by a reputable nasal specialist. If there is a shift in the nasal skeleton such that there is a crooked appearance, an in-office closed reduction of a nasal fracture may be considered for a straighter nasal appearance provided this is recognized within 10 days of trauma. Hope this helps, and wishing you well. Dr Joseph

A punch in a nose can hurt like heck. Bruising and swelling are almost always a consequence, and if there is indeed a fracture, it can be hairline, or truly displaced. This can generally be determined with a physical examination by a board certified or board eligible plastic surgeon or facial plastic surgeon. ER docs will generally go straight to ordering an x-ray, which can almost always be avoided. If displaced, there will most likely be a resultant deformity. If not, you will probably be ok. Get seen. Put your mind at ease. Good luck. 

It is difficult to tell if you have fractured your nose without an exam.  However, since your nose didn't bleed and you have no bruising, it is possible you are experiencing temporary swelling from the trauma.  This should resolve with time.  If you do not note improvement, I recommend you schedule an appointment with a plastic surgeon for further evaluation.