A controversial EU deal with Turkey to halt the flow of refugees into Europe may be in jeopardy, depending on Turkey's citizens being granted visa-free travel to the EU.