Pelosi cites Banks, Jordan's statements criticizing select committee as reason for booting them from panel