The failure to stem immigration will come back to 'bite' governments