Sahih Muslim
The Book on Government (Kitab Al-Imara)
Book Number: 020 / Hadith Number: 4726
It has been narrated on the authority of Anas b. Malik that the Messenger of Allah (may peace be upon him) would not come (back) to his family by night. He would come to them in the morning or in the evening. Another version of the tradition narrated on the some authority is a little difierently worded. It says: (He) would not enter (upon his household at night).