Abdullah bin Umar reported,
The Prophet ﷺ said, "Allah 
does not entrust a servant with the care of a flock, whether small or large, without questioning him about it on the Day of Resurrection, whether he upheld Allah's command among them or neglected it, to the point that He will question him even about his own household."
Ahmad 4637
Sahihحدثنا إسماعيل عن يونس عن الحسن
عن ابن عمر
أن النبي ﷺ قال لا يسترعي الله تبارك وتعالى عبدا رعية قلت أو كثرت إلا سأله الله تبارك وتعالى عنها يوم القيامة أقام فيهم أمر الله تبارك وتعالى أم أضاعه حتى يسأله عن أهل بيته خاصة
No references are available.
Its isnad is sahih. Yunus is Ibn Ubayd. Hasan is Basri. I have not found this hadith in any other location, nor in Majma al-Zawaid, so I suspect it is in one of the six books, its location in them simply hidden from me. Muslim reported, in 1:51, through the route of Yunus and others, from Hasan, from Maqil bin Yasar, a hadith close to this meaning. And in Majma al-Zawaid, 5:207, there is a hadith similar to this one, from the hadith of Abu Hurairah, attributed to Tabarani in al-Awsat. See also 4495.