People should not be going on holiday to countries placed on the amber list of travel restrictions, Boris Johnson has said.