Ayesha reported,
Quraysh and those who followed their religion, known as the Hums, used to stop on the evening of Arafah at Muzdalifa, saying, "We are the people of the sacred House." Meanwhile, the rest of the people and the Arabs would stop at Arafat. So Allah 
revealed, "Then depart from the place from which the people depart, and seek forgiveness from Allah" [Baqarah 2:199]. So they advanced and stood with the people at Arafat.
Azami 8540
Sahihعن عائشة قالت
كانت قريش ومن يدين دينها وهم الحمس يقفون عشية عرفة بالمزدلفة يقولون: نحن قطر البيت. وكان بقية الناس والعرب يقفون بعرفات فأنزل الله عز وجل: {ثم أفيضوا من حيث أفاض الناس واستغفروا الله} [البقرة: ١٩٩] فتقدموا فوقفوا مع الناس بعرفات.
Bukhari narrated it in the tafsir chapter (4520), and Muslim narrated it in the Hajj chapter (1219), both through the route of Abu Muawiya Muhammad bin Khazim, from Hisham bin Urwa, from his father, from Ayesha, who related it.Allah thus guided His Messenger to stand at Arafat, following the practice of the religion of Ibrahim, before he was sent as a prophet. "Al-Hums" is the plural of "Ahmas," meaning one who is firm and unyielding in zeal, and they were called by this name because, according to their own claim, they were strict in their religion.Urwa said, In the pre-Islamic era, people used to circle the Kaaba naked, except for the Hums. The Hums were from Quraysh and their descendants. The Hums used to take it upon themselves to provide for the people, a man would give another man garments to wear while circling, and a woman would give another woman garments to wear while circling. Whoever was not given clothing by the Hums would circle naked. The general body of people would depart from Arafat, while the Hums would depart from Jam (that is, Muzdalifa).This was mentioned by Bukhari (1665) and Muslim (1219).