'Kind of crazy': Mortgage rates soar, hurting housing affordability