Maliks Muwatta Book 54, Hadith Number 39.

Malik related to me from Sumayy, the mawla of Abu Bakr from Abu Salih from Abu Hurayra that the Messenger of Allah, may Allah bless him and grant him peace, said, “Travelling is a portion of the torment. It denies you your sleep, food, and drink. When you have accomplished your purpose, you should hurry back to your family.”