Microsoft Copilot (Microsoft 365): Generate icons for your agents using AI in Microsoft 365 Copilot

🚨 The Signal: Microsoft 365 Copilot agent builders can now use AI to generate custom icons for their agents. This change introduces a new vector for potential prompt injection or generation of inappropriate content, impacting governance of agentic AI.

The Impact

Agent builders are affected by the risk of generating inappropriate or malicious content through AI icon generation.

• Agent builders: Risk of generating inappropriate or misleading icons.
• Security teams: Need to monitor and govern AI-generated content for compliance.
• Organisations: Potential for reputational damage from unmoderated content.

The Action

1. Review and update existing AI governance policies to include AI-generated imagery for Copilot agents.
2. Educate Copilot agent builders on acceptable use policies for AI-generated content and prompt best practices.
3. Implement content moderation strategies for AI-generated icons, if available within Copilot agent management.
4. Monitor audit logs for agent creation and modification activities, looking for unusual icon generation patterns.

Domain: Agentic-AI · Impact: medium · Workload: Other