Taking the tape off my incisions and the scab coming off with, is the scar going to be worse because of that?

So my surgeon told me I could take the tape off my incisions off at about 20 days post op...my only question is that, I know the scabs are going to come off with it. Is that normal? Wouldn't that cause worse scarring? I know there's no going around it. They gotta come off. But I'm nervous. Plus how bad is it going to hurt??