A rift has formed between former Doctors with Colin Baker accusing Peter Davison of talking "absolute rubbish" after he claimed boys would lose a role model with a female Time Lord.