Implant removed 5 weeks ago, jaw/chin/lips still numb, should I see oral surgeon will they see me if I had surgery with dentist?

This doesn't sound right. Sounds like there has been trauma to the inferior alveolar and /or mental nerve. There is a window of time that, if needed, nerve repair surgery has the best prognosis which is usually within 6 months after the nerve is injured. I would recommend getting a second opinion immediately.

While most nerve injuries do recover on their own, it is important to establish care with an oral and maxillofacial surgeon who is experienced with trigeminal nerve injuries and repair. You should be seen soon, as timely evaluation and monitoring is critical in determining if recovery is appropriate, or if you may benefit from possible nerve repair surgery. 

It’s important to find out why you lost your dental implant. If you went for your regular check ups, then you should have had the implant checked on a regular basis and if you lost bone around your implants then your x-rays would have shown a gradual progression. At this point, it’s important to “map” the area of numbness.Every week draw a new “map“ and see if the area is getting larger, smaller, or staying the same. This will help determine the severity of the nerve damage and whether or not it is gradually healing.