Is roughness left over composite around Invisaligns attachments normal?

I just got my attachments on yesterday for my second set of aligners. Is it normal to have rough composite around the tooth where the attachment is on? Will the roughness go away with brushing or until I am done with the Invisaligns?