Vogel said he wished James had a couple more weeks to ease back in before the play-in tournament