Nose hurts 2 years post op rhinoplasty, feels like bones are cracking inside my nose. Suggestions?

This is not unusual to hear occasionally following rhinoplasty. You should consult an ENT doctor to see if there is something else like a sinus infection

There may not be anything possible for the surgical perspective, but I suggest you get a quality second opinion from somebody with the ENT background who is also trained in plastic surgery.
Get a thorough evaluation to make sure the incisions are properly aligned and there’s no bone or cartilage poking out.
Closing the incisions for rhinoplasty inside, the nostril is technically difficult.
If tissues are not, properly aligned, can be issues of potential contamination of Cartlidge.
The area is very vascular and tends to heal well overtime.
They’re probably isn’t much else to do but at least have someone Who knows nasal anatomy inside your nose.
Best,
Mats Hagstrom, MD