🔗 Share this article

Law enforcement agencies across the United Kingdom effectively campaigned to deploy a face scanning system acknowledged as biased against females, youths, and individuals from ethnic minority groups, after complaining that a more accurate version produced fewer potential suspects.

The Technology in Practice

British police utilize the national police database to carry out searches using historical face recognition. This procedure entails matching a reference photograph of a person of interest against a repository of over 19 million custody photos to find potential matches.

Admitted Bias

The Home Office conceded last week that the technology was biased. This admission came after a study by the National Physical Laboratory (NPL) determined it misidentified Black and Asian people and females at significantly higher rates than white men. The Home Office said it “had acted on the findings”.

“This raises the issue of whether this technology only becomes effective if users accept discrimination in race and sex. Convenience is a poor argument for overriding fundamental rights.”

Long-Standing Problem

Official papers reveal that this bias has been recognized for more than a year. Furthermore, police forces lobbied to reverse an earlier ruling that was designed to address the problem.

Senior officers were informed of the algorithmic discrimination in late 2024. The government-ordered laboratory study concluded the system was had a higher probability to produce incorrect matches for photos of women, Black people, and those under 40 years old.

A Policy U-Turn

In reaction, the national police leadership body ordered that the accuracy setting required for potential matches be raised to a point where the bias was significantly reduced.

However, this directive was overturned the following month after forces complained that the adjusted system was generating a lower number of “investigative leads”. NPCC documents indicate the higher threshold reduced the proportion of searches resulting in potential matches from over half to a mere 14%.

Profound Inequalities

Although the Home Office and NPCC refused to say what setting is now in operation, the latest independent review discovered the system could produce false positives for Black women almost 100 times more often than for white women at certain settings.

The ministry commented on these findings: “Our evaluation found that in a specific scenarios the software is more likely to incorrectly include some demographic groups in its match reports.”

Operational Effectiveness vs. Bias

Describing the impact of the temporary raise to the system's accuracy setting, the NPCC documents note: “The change greatly lessens the effect of discrimination across legally safeguarded attributes of ethnicity, age and sex but had a significant negative impact on police efficiency”. The papers further note that forces argued that “a previously useful tool returned outcomes of questionable value”.

Wider Implementation Proposals

Meanwhile, the UK administration has opened a two-and-a-half-month public review on its proposals to expand the use of biometric scanning systems. The minister for police the relevant minister has described the technology as the “biggest breakthrough since genetic fingerprinting”.

Expert and Oversight Concerns

Abimbola Johnson, head of the independent scrutiny and oversight board for the national policing equality strategy, said: “There was very little consideration in race action plan meetings of the technology deployment despite obvious cross-over with the strategy's goals.

“This disclosure show yet again that the pledges to combat discrimination policing has undertaken via the race action plan are not being translated into broader operations. Our reports have warned that innovative tools are being implemented in a landscape where ethnic inequalities, weak scrutiny and faulty information gathering continue to exist.

“Any use of this technology must adhere to rigorous official guidelines, be subject to external review, and prove it reduces rather than compounds racial disparity.”

Official Statement

A Home Office spokesperson said: “The Home Office takes the conclusions of the report seriously and we have already taken action. A updated software has been externally evaluated and acquired, which has demonstrated no measurable discrimination. It will be trialled in the coming months and will be undergo further assessment.

“The foremost aim is ensuring public safety. This revolutionary tool will support police to apprehend and prosecute offenders. There is human involvement in each stage of the procedure and no arrest or charge would be pursued without trained officers meticulously examining the results.”