Boris Johnson's sister says that if he attended parties then it 'would've been work' for him