Technology secretary admits Whitehall departments are not being transparent over way they use AI and algorithms
Not a single Whitehall department has registered the use of artificial intelligence systems since the government said it would become mandatory, prompting warnings that the public sector is “flying blind” about the deployment of algorithmic technology affecting millions of lives.
AI is already being used by government to inform decisions on everything from benefit payments to immigration enforcement, and records show public bodies have awarded dozens of contracts for AI and algorithmic services. A contract for facial recognition software, worth up to £20m, was put up for grabs last week by a police procurement body set up by the Home Office, reigniting concerns about “mass biometric surveillance”.
The Department for Work and Pensions has been using generative AI to read more than 20,000 documents a day to “understand and summarise correspondence” after which the full information is then shared with officials for decision-making. It has automated systems for detecting fraud and error in universal credit claims, and AI assists agents working on personal independence payment claims by summarising evidence. This autumn, DWP started deploying basic AI tools in jobcentres, allowing work coaches to ask questions about universal credit guidance in an attempt to improve the effectiveness of conversations with jobseekers.
The Home Office deploys an AI-powered immigration enforcement system, which critics call a “robo-caseworker”. An algorithm is involved in shaping decisions, including returning people to their home countries. The government describes it as a “rules-based” rather than AI system, as it does not involve machine-learning from data. It says it brings efficiencies by prioritising work, but that a human remains responsible for each decision. The system is being used amid a rising caseload of asylum seekers who are subject to removal action, now at about 41,000 people.
Several police forces use facial recognition software to track down suspected criminals with the help of artificial intelligence. These have included the Metropolitan police, South Wales police and Essex police. Critics have warned that such software “will transform the streets of Britain into hi-tech police line-ups”, but supporters say it catches criminal suspects and the data of innocent passersby is not stored.
NHS England has a £330m contract with Palantir to create a huge new data platform. The deal with the US company that builds AI-enabled digital infrastructure and is led by Donald Trump backer Peter Thiel has sparked concerns about patient privacy, although Palantir says its customers retain full control of the data.
An AI chatbot is being trialled to help people navigate the sprawling gov.uk government website. It has been built by the government’s digital service using OpenAI’s ChatGPT technology. Redbox, another AI chatbot for use by civil servants in Downing Street and other government departments, has also been deployed to allow officials to quickly delve into secure government papers and get rapid summaries and tailored briefings.
More Stories
Man who falsely claimed to be bitcoin creator sentenced for continuing to sue developers
Esports are booming in Africa – but can its infrastructure keep pace?
AI learns to distinguish between aromas of US and Scottish whiskies