Damian Green leaves home and refuses to comment after porn sacking