Arab Press

بالشعب و للشعب
Saturday, May 31, 2025

UK Police officers raise concerns about 'biased' AI data

UK Police officers raise concerns about 'biased' AI data

Police officers have raised concerns about using "biased" artificial-intelligence tools, a report commissioned by one of the UK government's advisory bodies reveals. The study warns such software may "amplify" prejudices, meaning some groups could become more likely to be stopped in the street and searched.

It says officers also worry they could become over-reliant on automation.

And it says clearer guidelines are needed for facial recognition's use.

"The police are concerned that the lack of clear guidance could lead to uncertainty over acceptable uses of this technology," the Royal United Services Institute (Rusi)'s Alexander Babuta told BBC News.

"And given the lack of any government policy for police use of data analytics, it means that police forces are going to be reluctant to innovate.

"That means any potential benefits of these technologies may be lost because police forces' risk aversion may lead them not to try to develop or implement these tools for fear of legal repercussions."

Rusi interviewed about 50 experts for its study, including senior police officers in England and Wales - who were not named - as well as legal experts, academics and government officials.

The work was commissioned by the Centre for Data Ethics and Innovation, which plans to draw up a code of practice covering the police's use of data analytics next year.


'Self-fulfilling prophecy'


One of the key concerns expressed was about using existing police records to train machine-learning tools, since these might be skewed by the arresting officers' own prejudices.

"Young black men are more likely to be stopped and searched than young white men, and that's purely down to human bias," said one officer.

"That human bias is then introduced into the datasets and bias is then generated in the outcomes of the application of those datasets."

An added factor, the report said, was people from disadvantaged backgrounds were more likely to use public services frequently. And this would generate more data about them, which in turn could make them more likely to be flagged as a risk.

Matters could worsen over time, another officer said, when software was used to predict future crime hotspots.

"We pile loads of resources into a certain area and it becomes a self-fulfilling prophecy, purely because there's more policing going into that area, not necessarily because of discrimination on the part of officers," the interviewee said.

There was disagreement, however, on how much scope should be given to officers wanting to ignore predictive software's recommendations.

"Officers often disagree with the algorithm," said one.

"I'd expect and welcome that challenge. The point where you don't get that challenge, that's when people are putting that professional judgement aside."

But another officer worried about others being too willing to ignore an app's recommendations, adding: "Professional judgement might just be another word for bias."


'Patchwork quilt'


Mr Babuta said this problem could be addressed.

"There are ways that you can scan and analyse the data for bias and then eliminate it," he told BBC News.

"[And] there are police forces that are exploring the opportunities of these new types of data analytics for actually eliminating bias in their own data sets."

But he added that "we need clearer processes to ensure that those safeguards are applied consistently".

In the meantime, one officer described the current landscape as being like "a patchwork quilt - uncoordinated and delivered to different settings and for different outcomes".

The National Police Chiefs' Council has responded saying UK police always seek to strike a balance between keeping people safe and protecting their rights.

"For many years police forces have looked to be innovative in their use of technology to protect the public and prevent harm and we continue to explore new approaches to achieve these aims," Assistant Chief Constable Jonathan Drake said.

"But our values mean we police by consent, so anytime we use new technology we consult with interested parties to ensure any new tactics are fair, ethical and producing the best results for the public."

Newsletter

Related Articles

Arab Press
0:00
0:00
Close
Meta and Anduril Collaborate on AI-Driven Military Augmented Reality Systems
EU Central Bank Pushes to Replace US Dollar with Euro as World’s Main Currency
European and Arab Ministers Convene in Madrid to Address Gaza Conflict
Head of Gaza Aid Group Resigns Amid Humanitarian Concerns
U.S. Health Secretary Ends Select COVID-19 Vaccine Recommendations
Trump Warns Putin Is 'Playing with Fire' Amid Escalating Ukraine Conflict
India and Pakistan Engage Trump-Linked Lobbyists to Influence U.S. Policy
U.S. Halts New Student Visa Interviews Amid Enhanced Security Measures
Trump Administration Cancels $100 Million in Federal Contracts with Harvard
SpaceX Starship Test Flight Ends in Failure, Mars Mission Timeline Uncertain
King Charles Affirms Canadian Sovereignty Amid U.S. Statehood Pressure
Iranian Revolutionary Guard Founder Warns Against Trusting Regime in Nuclear Talks
Netanyahu Accuses Starmer of Siding with Hamas
Calls Grow to Resume Syrian Asylum Claims in UK
UAE Offers Free ChatGPT Plus Subscriptions to Citizens
Denmark Increases Retirement Age to 70, Setting a European Precedent
Iranian Director Jafar Panahi Wins Palme d'Or at Cannes
Israeli Airstrike Kills Nine Children of Gaza Doctor
Lebanon Initiates Plan to Disarm Palestinian Factions
Iran and U.S. Make Limited Progress in Nuclear Talks
Trump Administration's Tariff Policies and Dollar Strategy Spark Global Economic Debate
OpenAI Acquires Jony Ive’s Startup for $6.5 Billion to Build a Revolutionary “Third Core Device”
Turkey Weighs Citizens in Public as Erdoğan Launches National Slimming Campaign
UK Suspends Trade Talks with Israel Amid Gaza Offensive
Iran and U.S. Set for Fifth Round of Nuclear Talks Amid Rising Tensions
Russia Expands Military Presence Near Finland Amid Rising Tensions
Indian Scholar Arrested in Crackdown Over Pakistan Conflict Commentary
Israel Eases Gaza Blockade Amid Internal Dispute Over Military Strategy
President Biden’s announcement of advanced prostate cancer sparked public sympathy—but behind closed doors, Democrats are in panic
Mount Lewotobi Laki-Laki Erupts Again, Spewing Ash Cloud over Flores Island
Indian jet shootdown: the all-robot legion behind China’s PL-15E missiles
The Chinese Dragon: The True Winner in the India-Pakistan Clash
Australia's Venomous Creatures Contribute to Life-Saving Antivenom Programme
The Spanish Were Right: Long Working Hours Harm Brain Function
Did Former FBI Director Call for Violence Against Trump? Instagram Post Sparks Uproar
US and UAE Partner to Develop Massive AI Data Center Complex
Apple's $95 Million Siri Settlement: Eligible Users Have Until July 2 to File Claims
US and UAE Reach Preliminary Agreement on Nvidia AI Chip Imports
President Trump and Elon Musk Welcomed by Emir of Qatar Sheikh Tamim with Cybertruck Convoy
Strong Warning Issued: Do Not Use General Chatbots for Medical, Legal, or Educational Guidance
NVIDIA and Saudi Arabia Launch Strategic Partnership to Establish AI Centers
Trump Meets Syrian President Ahmad al-Shara in Historic Encounter
US and Saudi Arabia Sign Landmark Agreements Across Multiple Sectors
Why Saudi Arabia Rolled Out a Purple Carpet for Donald Trump Instead of Red
Elon Musk Joins Trump Meeting in Saudi Arabia
Trump says it would be 'stupid' not to accept gift of Qatari plane
Quantum Computing Threatens Bitcoin Security
Michael Jordan to Serve as Analyst for NBA Games
Senate Democrats Move to Censure Trump Over Qatar Jet Gift
Hamas Releases Last Living US Hostage from Gaza Amid Ongoing Conflict
×