David Cameron jokes about his empty diary