If I take my nose implant out will the tip look weird considering it is a little higher now?

Any implant will stretch the skin soft tissue envelope. If you choose to remove it, the skin soft tissue envelope on your nose will have to contract. This may be quite unpredictable unless you replace it with another implant or graft. I usually recommend filling that space with either cartilage graft or dermal implant like Alloderm. Once skin contraction occurs, it is almost impossible to re-expand that skin and may pull your tip upwards even more.