The Prophet ﷺ ruled that a lifetime gift belongs to the one to whom it was given.
قضى النبي ﷺ بالعمرى، أنها لمن وهبت له.
Bukhari related it in the Book of Gifts (2625), and Muslim in the Book of Gifts (1625:25), both from the hadith of Yahya bin Abu Kathir, from Abu Salama bin Abdul-Rahman, from Jabir bin Abdullah who said, and then he mentioned it.