Fiqh-us-Sunnah Volume 5, Hajj and ‘Umrah, Fiqh 5.041B.
A pilgrim should begin his talbiyah from the time he wears his ihram and continue it until throwing the first pebble at the Aqabah Jamarah on the 10th of Zhul-Hijjah, the Day of Nahr (sacrifice). Then he should stop saying talbiyah, as the Prophet (peace be upon him) did, according to a hadith transmitted by the Group. Ath-Thawri, the Hanafi school, Ash-Shafi’i, and the majority of scholars also hold this view. Ahmad and Ishaq, however, are of the view that a pilgrim must continue talbiyah until he has stoned all the three jamarahs. After that he may stop saying talbiyah. Malik holds that a pilgrim must continue talbiyah until the end of the Day of ‘Arafah (the 9th of Zhul-Hijjah). This applies only to those performing Hajj.
As for those performing ‘Umrah, they may discontinue talbiyah after kissing the Black Stone and starting their tawaf. Ibn ‘Abbas reports that the Prophet (peace be upon him) used to discontinue talbiyah after kissing the Black Stone (at the start of his tawaf). (Reported by Tirmizhi who considers it a sound hadith. When a person puts on ihram from a miqat he should discontinue ralbiyah on entering the Haram (Sacred Mosque). And those who put on ihram from Ju’rana or Tan’im, they should discontinue it on reaching the houses of Maklcah) In practice, most of the scholars follow this hadith.