I agree, and I try not to message people on their time off, but if I felt it was important for some reason (for example, maybe if I'm not going to be around on that day which is the only reason I can remember doing it), I'd make sure to clarify expectations, or lack thereof.