The Book on Government (Kitab Al-Imara)
Muslim :: Book 20 : Hadith 4476
It has been narrated on the authority of 'Abdullah that the Messenger of Allah (may peace be upon him) said: The Caliphate will remain among the Quraish even if only two persons are left (on the earth),