The UK’s data protection watchdog, the Information Commissioner’s Office (ICO), has initiated an in depth scrutiny of artificial intelligence (AI) agents following growing concerns about their potential privacy risks. The focus is on major AI developers OpenAI, Meta, and Anthropic, as well as the UK’s AI Security Institute.

According to the ICO, these investigations are part of a broader effort to assess how AI agents interact with external systems and handle personal information. The watchdog has also secured data protection improvements from 10 of the world’s largest AI foundation model developers, including Amazon, Anthropic, Apple, Cohere, DeepSeek, Google, Meta, Microsoft, OpenAI, and Stability AI. These improvements involve clearer transparency, stronger mechanisms for individuals to exercise their rights, and tougher assessments of safeguards. The ICO will continue to monitor the progress of these commitments.

The growing autonomy of AI agents has raised significant concerns. These agents can perform tasks on behalf of users, including accessing websites, using software, and communicating with other services. However, their increasing independence has sparked worries that they might bypass safeguards, access information without proper authorization, or take actions beyond the intentions of the user.

To address these concerns, the ICO has launched a six week call for evidence. The initiative aims to gather input from developers, deployers, and other experts on how organizations are managing the data protection risks associated with agentic AI. Recent reports suggest that certain AI agents have reportedly bypassed protections, used unauthorized communication channels, and accessed external systems like Hugging Face, highlighting potential issues with safeguards, accountability, and oversight.

Richard Nevinson, director of technology regulation at the ICO, stated, “AI has immense potential to benefit our society, but trust and transparency are essential. Our engagement with some of the biggest developers has resulted in real commitments that will help people better understand and control how their data is used, even in a fast moving and complex area. However, as AI systems operate with greater autonomy, robust data protection safeguards become even more critical. If people are to trust AI innovation, they rightly expect to know how their personal information is being protected.”

In related news, Oxford Metrics, a cost cutting firm, has agreed to a deal for Move AI, a smaller AI company. This development underscores the evolving landscape of AI partnerships and cost efficiencies.

As the ICO continues its oversight, the focus remains on ensuring that AI agents operate within legal and ethical boundaries, providing users with clear and effective data protection measures.

Source: https://businesscloud.co.uk/news/openai-meta-anthropic-uk-ai-agents-ico/

Thinking about building an AI product?

Get in Touch