The Prophet ﷺ said, "Do not wipe while you are praying. If you absolutely must do so, then once, to level the pebbles."
حدثنا مسلم بن إبراهيم حدثنا هشام عن يحيى عن أبي سلمة
أن النبي ﷺ قال لا تمسح وأنت تصلي فإن كنت لا بد فاعلا فواحدة تسوية الحصى
Muslim narrated it in Al-Masajid, chapter on the disapproval of wiping away pebbles and leveling the dirt during prayer, no. 546, from the hadith of Hisham Dastawai, and Bukhari in Al-Amal fi As-Salah, chapter on wiping away pebbles during prayer, no. 1207, from the hadith of Yahya bin Abu Kathir, through this same chain.