Britain's finance industry has given up on efforts to keep full access to the European Union after Brexit.