A builder accused of using a digger to cause up to £4 million of damage to a row of newly-built retirement homes has appeared in court.