Communities Secretary Greg Clark says "there's no point in scrapping with each other" over the Budget.