How likely is it for a bone graft to fall out after 3 weeks?

It's not likely. If a graft is going to fall out, it will usually fall out in the first few days after the procedure. By 3 weeks, your body has healed around it enough that it shouldn't go anywhere. But you can expect small particles from the graft will come out for several months after the procedure. That's nothing to be worried about.