The Messenger of Allah ﷺ addressed us and said, "People, Allah has made Hajj obligatory upon you, so perform the pilgrimage."A man asked, "Every year, Messenger of Allah?"The Prophet ﷺ remained silent, until the man repeated his question three times. Then the Messenger of Allah ﷺ said, "Had I said yes, it would have become obligatory, and you would not have been able to bear it."He then said, "Leave me as I leave you. Those who came before you were destroyed only because of their excessive questioning and their disagreements with their prophets. When I command you to do something, do as much of it as you can, and when I forbid you from something, abandon it."
خطبنا رسول الله ﷺ فقال: أيها الناس! قد فرض الله عليكم الحج فحجوا. فقال رجل: أكل عام يا رسول الله؟ فسكت حتى قالها ثلاثا، فقال رسول الله ﷺ: لو قلت: نعم، لوجبت، ولما استطعتم ثم قال: ذروني ما تركتكم، فإنما هلك من كان قبلكم بكثرة سؤالهم واختلافهم على أنبيائهم، فإذا أمرتكم بشيء فأتوا منه ما استطعتم، وإذا نهيتكم عن شيء فدعوه.
Muslim narrated it in the book of Hajj (1337), from Zuhayr bin Harb, who said, Yazid bin Harun told us, Rabi bin Muslim Qurashi informed us, from Muhammad bin Ziyad, from Abu Hurairah, and he related it.There are other hadiths with the same meaning mentioned in the book of Hajj.