'Keep your hands in your pockets', Tory minister tells male MPs