The transplanted hair settle down within 72 hours of surgery. SO, there is no problem in your flying four days after surgery. Infact, many of my patients fly the next day after surgery and I have never found any problem in them.
In our clinic we have volume of International clients. They can safely travel out the second day after the procedure.