Quit Finasteride after 3 weeks because of sides - why is my hair shedding like crazy?

I took finasteride for 24 days and noticed sexual side effects. My hairloss had not bothered me too much yet so I figured that I would stop for a while and see a doctor to re-assess. Before I stopped I entered into what I think is my first shed: loosing 3-5 hairs every time I run my hair through my scalp. Its now been two weeks and although the sexual side effects have subsided my hair is still shedding at the same rate. When will this stop? Is the hair lost during the shed permanent?