When they asked him to spend more time with them, he declined.