Sahih Muslim Book 20, Hadith Number 4726.

Chapter : Undesirability of returning to one’s family at night (after a long absence from home).

It has been narrated on the authority of Anas b. Malik that the Messenger of Allah (may peace be upon him) would not come (back) to his family by night. He would come to them in the morning or in the evening. Another version of the tradition narrated on the some authority is a little differently worded. It says: (He) would not enter (upon his household at night).