"For me to hear every story he had, he would have had to stay for months." Another tiny pause, and then Lan Wangji says, "And I did not want to keep him from you." They both know the nature of how time works in this place, so it is entirely possible that he is teasing Galahad, just a very little bit.