Sahih Muslim Book 26, Hadith Number 5422.

Chapter : It is prohibited for two persons to converse secretly without the consent of the third one.

‘Abdullah reported Allah’s Messenger (may peace be upon him) as saying: If you are three, two should not converse secretly to the exclusion of your companion for that hurts his feelings.