Abu Bakr performed the Hajj with us during his caliphate, and he then mentioned the hadith.
حدثنا يعقوب حدثنا أبي عن ابن إسحاق قال وحدثني العلاء بن عبد الرحمن عن رجل من بني سهم
حج علينا أبو بكر رضي الله عنه في خلافته فذكر الحديث
This repeats what came before it. "He performed hajj upon us" means he performed hajj and then came to us, or he performed hajj while coming to us.