Too soon for Boris Johnson to make a return, says Grant Shapps