Microsoft's new agentic AI features introduce new security risks introduced by AI, like prompt injection — firm acknowledges new and unexpected risks are possible

Microsoft 365 Copilot
(Image credit: Shutterstock)

Microsoft just released a new agentic AI to Windows 11 Insiders, allowing users to take advantage of artificial intelligence to execute tasks like file organization and sending emails. However, the company has confirmed the potential security risks brought about by giving artificial intelligence access to your files in a new support document. Because of this, it created an experimental feature called agent workspace, which gives the AI its own limited profile on your Windows PC.

Agent workspace is similar to a limited user profile on Windows 11, allowing the AI agent to use common apps and files on your system, but preventing it from using software installed only for specific users and from accessing data locked behind the user profile directory (C:\Users\) unless given specific access. Microsoft says that “this setup is more efficient than a full virtual machine such as Windows Sandbox, while still providing security isolation, support for parallel execution, and keeping the user in control.” It has also ensured that AI agents produce logs of everything that they do, must have limited privileges, and can only be accessed by their original creator.

Screenshot of Microsoft's agentic AI warning

(Image credit: Tom's Hardware)

Despite those measures, the company recognizes the inherent risks by giving an AI agent unprecedented access to your machine. “Agentic AI applications introduce novel security risks, such as cross-prompt injection (XPIA), where malicious content embedded in UI elements or documents can override agent instructions, leading to unintended actions like data exfiltration or malware installation.”

Thankfully, Microsoft isn’t forcing this feature on its users (yet). The company says that it’s turned off by default and that you need to specifically turn on the setting in System > AI Components > Experimental agentic features. Aside from that, it also warns that you should understand the security implications of using a system such as this before turning it on, especially as activating it turns it on for all users on your system.

Microsoft has been pushing hard for the adoption of AI, especially with the arrival of its Copilot+ PCs. However, it seems that most buyers do not care about their capabilities and only buy them because they’re what’s available (with some even jumping to macOS because of their frustration with Windows). Aside from this, most of the exclusive features found on these AI devices aren’t that useful for most consumers, and even ones that have potential, like Microsoft Recall, are security nightmares. While this agentic AI might be useful for the average user on the surface, it also has several red flags, even with all the limitations that the company has put on it.

Google Preferred Source

Follow Tom's Hardware on Google News, or add us as a preferred source, to get our latest news, analysis, & reviews in your feeds.

Jowi Morales
Contributing Writer

Jowi Morales is a tech enthusiast with years of experience working in the industry. He’s been writing with several tech publications since 2021, where he’s been interested in tech hardware and consumer electronics.

  • DS426
    I estimate that the risks are pretty high for cross-prompt injection. There's already plenty of both malicious and security-research-based attacks that have been successful. One recent example where Gmail is utilized to hijack Gemini:

    https://www.tomshardware.com/tech-industry/cyber-security/researcher-shows-how-comprimised-calendar-invite-can-hijack-chatgpt
    What's scary is that prompt injection attacks tend to be zero-click exploits. Not good!
    Reply
  • SomeoneElse23
    Let's also remember how secure Windows tends to be.

    I will not be downgrading from Win10 to Win11.
    Reply
  • heffeque
    SomeoneElse23 said:
    Let's also remember how secure Windows tends to be.

    I will not be downgrading from Win10 to Win11.
    I bought a new PC and sadly had to downgrade to W11.
    I'll surely try Bazzite out and hopefully "park" W11 to only use that crapware/spyware for "emergencies".
    Reply
  • Heat_Fan89
    My Windows 11 PC's are my gaming rigs. I don't do anything besides clicking on a game shortcut or launch Steam or the XBOX app. This operating system jalopy needs to be given away for free. They have a lot of nerve charging people for this software.
    Reply
  • USAFRet
    Heat_Fan89 said:
    This operating system jalopy needs to be given away for free. They have a lot of nerve charging people for this software.
    It mostly is.

    Free upgrade from Win 10.
    Or included with whatever prebuilt thing you bought.
    Reply