The Messenger of Allah ﷺ said, "When a man gets up from his seat and then returns to it, he has the greater right to it."
حدثنا أبو كامل حدثنا زهير حدثنا سهيل عن أبيه
قال رسول الله ﷺ إذا قام الرجل من مجلسه ثم رجع إليه فهو أحق به
Its isnad is sahih. Bukhari also related it in Adab al-Mufrad, p. 166, through the route of Sulayman bin Bilal.