Antisemitism not 'sole focus' of former Labour MPs who joined Independent Group, shadow cabinet member Barry Gardiner says