The Messenger of Allah ﷺ said, "I have considered ordering a man to lead the people in prayer, then ordering that those who do not pray with us have their houses burned down upon them."
حدثنا يحيى بن آدم حدثنا إسرائيل عن أبي إسحاق عن أبي الأحوص
قال رسول الله ﷺ لقد هممت أن آمر رجلا فيصلي بالناس ثم آمر بأناس لا يصلون معنا فتحرق عليهم بيوتهم
Its isnad is sahih. Muslim also narrated it, as in Muntaqa 1543. This warning is directed at those who used to stay away from the Friday prayer, as indicated by the coming narration 3816 of this hadith, and likewise by the narration in Muntaqa.