Recalling loan players

Hi guys, I've loaned out a number of youngsters and always have the recall option incase they aren't doing well. Some of the players I have loaned out it won't let me recall? Any ideas why?