英国庇护AI工具面临准确性与透明度审查
WIRED报道称,英国移民部使用基于OpenAI 2023年GPT-4和Microsoft Foundry构建的庇护案件摘要工具ACS及庇护政策搜索工具APS,用于总结庇护面谈和检索国别政策信息。开放权利组织发现,ACS被判定不可用的摘要比例高于试点评估公布的9%错误率,APS摘要则缺少质量控制;英国法官还指控移民部在拒绝庇护申请时引用了“AI幻觉”文件。移民部称所有决定均由受训个案工作人员作出,AI仅提供辅助且工具受到监控;信息委员会正调查该部门拒绝说明人员如何使用及接受相关培训,ICIBI尚未确认是否考虑调查。
据报道,GPT-4工具已进入高风险的庇护程序,同时面临质量、披露和数据监管方面的明确问题。
A UK government watchdog is considering an investigation into the Home Office’s use of generative AI tools to process asylum applications, WIRED has learned. The potential probe follows lawmakers and researchers publicly questioning the tools’ accuracy and the government’s secrecy around their use.
The Independent Chief Inspector of Borders and Immigration (ICIBI), which monitors the Home Office’s management of borders, immigration, and customs, has asked digital rights nonprofit Open Rights Group (ORG) to share more information on the tools as it draws up plans for the topics it will inspect next year, campaigner Sara Alsherif tells WIRED. ORG’s findings come from a six-month investigation into the tools, which involved 11 parliamentary questions, two ministerial letters, and 10 public records requests that attempt to pry details from the Home Office, which has withheld details on the tools.
The ICIBI tells WIRED it cannot confirm what topics are under active consideration before it publishes its annual inspection priorities, but it says it is aware of concerns about the use of AI tools and pointed to its findings last year that one of the tool’s “effectiveness and reliability were varied.”
#UK Home Office#Asylum Case Summarisation#Asylum Policy Search#OpenAI#GPT-4#Microsoft Foundry#Independent Chief Inspector of Borders and Immigration#Open Rights Group#Information Commission#Public Law Project