The Messenger of Allah ﷺ addressed the people and said, "Allah has made the Hajj obligatory upon you."A man asked, "Every year?"The Messenger of Allah ﷺ remained silent, until the man repeated his question three times. Then he said, "If I had said yes, it would have become obligatory, and if it had become obligatory, you would not have been able to fulfill it. Leave me as I leave you. Those who came before you were destroyed only because of their excessive questioning and their disagreements with their prophets. So when I command you to do something, do as much of it as you can, and when I forbid you from something, avoid it."
أخبرنا محمد بن عبد الله بن المبارك المخرمي قال حدثنا أبو هشام واسمه المغيرة بن سلمة قال حدثنا الربيع بن مسلم قال حدثنا محمد بن زياد
خطب رسول الله ﷺ الناس فقال إن الله عز وجل قد فرض عليكم الحج فقال رجل في كل عام فسكت عنه حتى أعاده ثلاثا فقال لو قلت نعم لوجبت ولو وجبت ما قمتم بها ذروني ما تركتكم فإنما هلك من كان قبلكم بكثرة سؤالهم واختلافهم على أنبيائهم فإذا أمرتكم بالشيء فخذوا به ما استطعتم وإذا نهيتكم عن شيء فاجتنبوه
Muslim narrated it in the Book of Hajj, chapter on the obligation of Hajj once in a lifetime, hadith no. 1337, from the hadith of Rabi bin Muslim through this same chain, and it is also in Sunan al-Kubra, hadith no. 3598.