This is the time of the year, the males are hanging around looking for the female to come out. So if they are hanging around your house, you may have a bigger problem.
You should look into getting a carpenter bee kit with Cyonara in it as opposed to Cyper WP because Cyper WP can leave a powdery residue on whatever surface you are treating. Depending on which kit you get it should help prevent the carpenter bees from coming back. I made the mistake of buying one with Cyper WP first and THEN did my research lol. PM me if you need a recommendation on a product.