Boris Johnson has warned it would be "mad" to end up with a Brexit settlement that does not allow the UK to enjoy the "economic freedoms" of leaving the European Union.