I served the Prophet ﷺ for nine years, and I do not recall him ever saying to me, "Why didn't you do such and such?" nor did he ever criticize me for anything.
حدثنا إسحاق بن يوسف الأزرق حدثنا زكريا بن أبي زائدة عن سعيد بن أبي بردة
خدمت النبي ﷺ تسع سنين فما أعلمه قال لي قط هلا فعلت كذا وكذا ولا عاب علي شيئا قط
Its isnad is sahih. Bukhari narrated it, 11/456, no. 6038, in Fath al-Bari, in the Book of Manners, Good Character, as did Muslim, 4/180, no. 2309, and Abu Dawud, 4/247, no. 4774, with similar wording, and Tirmidhi, 3/269, no. 2015, in the Book of Righteousness, What Has Been Said About the Character of the Prophet ﷺ, and he said, hasan sahih.