Small hole in my incision is leaking pus. I'm three weeks post-op. What should I do?

Last night a small hole opened up in my incision, leaking blood and pus. I called my PS. He said it is probably a boil and needs to be cleaned with peroxide. I did that and it seemed to get better. I did it again this morning because it was still leaking. Tonight it is still leaking. My PS is out of town now or I would call him again. Does this sound normal? Should I be concerned that it is still leaking? My PS said it would probably be better this morning and now I'm concerned. Help!