UK Home Office asylum AI tools face scrutiny over accuracy and transparency
WIRED reported that the UK Home Office uses the Asylum Case Summarisation and Asylum Policy Search tools, built on OpenAI’s 2023 GPT-4 and Microsoft Foundry, to summarize asylum interviews and retrieve country-policy information. Open Rights Group found more ACS summaries unfit for use than the pilot evaluation’s published 9% error rate and no quality control for APS summaries; a UK judge also accused the Home Office of citing an AI-hallucinated document in an asylum refusal. The Home Office said trained caseworkers make all decisions, AI is only an aid, and the tools are monitored, while the Information Commission is investigating the department’s refusal to explain staff use and training; ICIBI has not confirmed that it is considering an investigation.
The reported deployment brings GPT-4-based tools into high-stakes asylum processing amid documented quality concerns, limited disclosure, and an active data-regulator inquiry.
A UK government watchdog is considering an investigation into the Home Office’s use of generative AI tools to process asylum applications, WIRED has learned. The potential probe follows lawmakers and researchers publicly questioning the tools’ accuracy and the government’s secrecy around their use.
The Independent Chief Inspector of Borders and Immigration (ICIBI), which monitors the Home Office’s management of borders, immigration, and customs, has asked digital rights nonprofit Open Rights Group (ORG) to share more information on the tools as it draws up plans for the topics it will inspect next year, campaigner Sara Alsherif tells WIRED. ORG’s findings come from a six-month investigation into the tools, which involved 11 parliamentary questions, two ministerial letters, and 10 public records requests that attempt to pry details from the Home Office, which has withheld details on the tools.
The ICIBI tells WIRED it cannot confirm what topics are under active consideration before it publishes its annual inspection priorities, but it says it is aware of concerns about the use of AI tools and pointed to its findings last year that one of the tool’s “effectiveness and reliability were varied.”
#UK Home Office#Asylum Case Summarisation#Asylum Policy Search#OpenAI#GPT-4#Microsoft Foundry#Independent Chief Inspector of Borders and Immigration#Open Rights Group#Information Commission#Public Law Project