Sahih Bukhari Volume 9, Book 89, Hadith Number 254.

Narrated By Ibn ‘Umar : Allah’s Apostle said, “This matter (caliphate) will remain with the Quraish even if only two of them were still existing.”