New book claims William and Harry began to drift apart years before Meghan arrived