Is it bad if I take my trays out every hour for a couple of minutes to smoke. I still wear them for 22 hours of the day.

Even you’re still wearing your trays 20+ hours, it’s best that your teeth are subjected to constant pressure by the aligners in your mouth continuously for the best correction movement results. Taking your aligners out every hour for couple of minutes at a time disrupts the mechanism of how these aligners function. I’d highly recommended you stop taking your aligners out every hour to smoke. Obviously there are side perks to that as well. Another issue you may have (if you have attachements places be on your teeth), by taking your aligners out every hour, you chance breaking or wearing down those attachements which are white fillings materials.