Maliks Muwatta Book 20, Hadith Number 102.

Section : Concerning Someone who is Hindered (From Going To The House) by Something Other than an Enemy.

Yahya related to me from Malik from Yahya ibn Said that he had heard that A’isha, the wife of the Prophet, may Allah bless him and grant him peace, used to say, “Only the House frees a person in ihram from ihram.”