The Messenger of Allah ﷺ said, "Children of Abd Manaf, do not prevent anyone from circling this House and praying at any hour they wish, by night or by day."
حدثنا يحيى بن حكيم حدثنا سفيان بن عيينة عن أبي الزبير عن عبد الله بن بابيه
قال رسول الله ﷺ يا بني عبد مناف لا تمنعوا أحدا طاف بهذا البيت وصلى أية ساعة شاء من الليل والنهار
[Its chain of transmission is sahih] Abu Dawud reported it in the Book of Rites of Hajj, chapter on tawaf after Asr, hadith 1894, from the hadith of Sufyan through this chain. Tirmidhi graded it sahih, hadith 868, as did Hakim and Dhahabi, and Ibn Khuzayma, hadith 2747, and Ibn Hibban (Mawarid), hadith 626, 627.