I'm not sure when they leave, but I know that they migrate back during the beginning of April. We've seen dozens of them flying through Wheat Ridge each year.
This year I found some resting in a neighbors tree. It was really cool to see them early in the morning, waiting to warm up with the sun.