The Prophet ﷺ said, "Children of Abd Manaf, do not prevent anyone from circumambulating this House and praying at any hour they wish, by night or by day."
حدثنا أبو عمار وعلي بن خشرم قالا حدثنا سفيان بن عيينة عن أبي الزبير عن عبد الله بن باباه
أن النبي ﷺ قال يا بني عبد مناف لا تمنعوا أحدا طاف بهذا البيت وصلى أية ساعة شاء من ليل أو نهار
[Its chain of transmission is sahih]. Also reported by Abu Dawud in the chapter on al-Manasik, on the topic of tawaf after Asr, hadith no. 1894, and Ibn Majah, hadith no. 1254, and Nasai, 5/223, hadith no. 2927, from the hadith of Sufyan bin Uyayna through this same route. Abu Zubayr explicitly stated that he heard it directly, as recorded by Nasai, hadith no. 586, and Humaydi, hadith no. 561 (in my edition), and others. Ibn Khuzayma graded it sahih, no. 2747, as did Ibn Hibban, hadith nos. 626 and 627, and Hakim, 1/448, and Dhahabi, and others.On this subject there is also a report from Ibn Abbas [Tahawi in Maani al-Athar, 2/186], and from Abu Dharr [Ahmad, 5/165, and Ibn Khuzayma, hadith no. 2748].