Can I remove the nasal cast? It's plaster on

I broke my nose around 2 weeks ago and the doctor did a small surgical procedure to place it back because of certain rules we have here. Basically there was no cutting or anything he just put the bone back in place. He put a small Cast on my nose with plaster to stick it but it's irritating me A lot can I remove it early Or do I have to wait the 5 days