No. I had to add a few new iPads, so I opened the organizer, clicked the 'use for development' button and it was good. It took a little bit for the actual provisioning profile to update but I was able to run the dev app on the device right away.

This was yesterday morning. I haven't tried today, though.