Yes, let them warm up completely to room temperature.
The top surface cannot be damp/sticky at all. It has to be completely dry like if you pulled it off of the cooling rack after baking.

Originally Posted by Cookies! Parr Excellence!:
Wow, I never thought about decorating frozen, already baked cookies. So basically, you are saying let them warm up to room temperature before decorating?