Issue Summary
When interacting with an Azure AI Foundry Hosted Agent published to Microsoft Teams, images uploaded using the Attach (π) button are processed correctly. However, images pasted directly into the Teams chat using Ctrl+V are not forwarded to the hosted agent.
As a result, the agent receives only the text prompt and cannot analyze or summarize the pasted image.
Environment
- Azure AI Foundry Hosted Agent (Python)
- Protocol: Responses
- Published to Microsoft Teams through Azure AI Foundry
- Vision-capable model (GPT-4o / GPT-5)
Working Scenario (Image Upload)
When an image is uploaded using the Teams Attach (π) button, the request received by the hosted agent contains both the text prompt and the image.
Example log:
The agent successfully processes the image and returns the expected response.
Failing Scenario (Ctrl+V Paste)
When the same image is pasted into the Teams chat using Ctrl+V, the hosted agent receives only the text prompt.
Example log:
No image content is included in the request. Specifically, there is no:
-
input_file
-
input_image
-
image_url
- Base64 image data
Because the image is missing from the request, the agent responds that no image was received.
Investigation Findings
We investigated the issue using Application Insights and custom logging.
The hosted agent receives:
This confirms that uploaded images are correctly forwarded to the Responses API.
Image pasted using Ctrl+V
The hosted agent receives only:
The image is not present anywhere in the request received by the hosted agent.
This indicates that the image is lost before the request reaches the agent.
Expected Behavior
Images pasted into Microsoft Teams using Ctrl+V should be forwarded to Azure AI Foundry Hosted Agents in the same way as images uploaded using the Attach (π) button.
The Responses API request should include the pasted image as an input_file (or equivalent multimodal input), allowing the vision model to process it.
Actual Behavior
- Attach (π) upload: β
Image reaches the hosted agent and is processed successfully.
- Ctrl+V pasted image: β Only the text prompt reaches the hosted agent. The image is not included in the request.
Impact
Users naturally paste screenshots using Ctrl+V in Microsoft Teams. Since these images are not forwarded to Azure AI Foundry Hosted Agents, vision capabilities cannot be used unless users explicitly upload the image via the Attach button.
Request
Please investigate the Teams-to-Foundry integration for Hosted Agents using the Responses protocol and verify whether clipboard-pasted images (image/png, image/jpeg, etc.) are expected to be forwarded to the hosted agent.
If this scenario is supported, please identify why pasted images are not being included in the Responses API request. If it is not currently supported, please confirm whether this is a known limitation or whether support for pasted images is planned.
Issue Summary
When interacting with an Azure AI Foundry Hosted Agent published to Microsoft Teams, images uploaded using the Attach (π) button are processed correctly. However, images pasted directly into the Teams chat using Ctrl+V are not forwarded to the hosted agent.
As a result, the agent receives only the text prompt and cannot analyze or summarize the pasted image.
Environment
- Azure AI Foundry Hosted Agent (Python)
- Protocol: Responses
- Published to Microsoft Teams through Azure AI Foundry
- Vision-capable model (GPT-4o / GPT-5)
Working Scenario (Image Upload)
When an image is uploaded using the Teams Attach (π) button, the request received by the hosted agent contains both the text prompt and the image.
Example log:
The agent successfully processes the image and returns the expected response.
Failing Scenario (Ctrl+V Paste)
When the same image is pasted into the Teams chat using Ctrl+V, the hosted agent receives only the text prompt.
Example log:
No image content is included in the request. Specifically, there is no:
-
input_file
-
input_image
-
image_url
- Base64 image data
Because the image is missing from the request, the agent responds that no image was received.
Investigation Findings
We investigated the issue using Application Insights and custom logging.
The hosted agent receives:
This confirms that uploaded images are correctly forwarded to the Responses API.
Image pasted using Ctrl+V
The hosted agent receives only:
The image is not present anywhere in the request received by the hosted agent.
This indicates that the image is lost before the request reaches the agent.
Expected Behavior
Images pasted into Microsoft Teams using Ctrl+V should be forwarded to Azure AI Foundry Hosted Agents in the same way as images uploaded using the Attach (π) button.
The Responses API request should include the pasted image as an input_file (or equivalent multimodal input), allowing the vision model to process it.
Actual Behavior
- Attach (π) upload: β
Image reaches the hosted agent and is processed successfully.
- Ctrl+V pasted image: β Only the text prompt reaches the hosted agent. The image is not included in the request.
Impact
Users naturally paste screenshots using Ctrl+V in Microsoft Teams. Since these images are not forwarded to Azure AI Foundry Hosted Agents, vision capabilities cannot be used unless users explicitly upload the image via the Attach button.
Request
Please investigate the Teams-to-Foundry integration for Hosted Agents using the Responses protocol and verify whether clipboard-pasted images (image/png, image/jpeg, etc.) are expected to be forwarded to the hosted agent.
If this scenario is supported, please identify why pasted images are not being included in the Responses API request. If it is not currently supported, please confirm whether this is a known limitation or whether support for pasted images is planned.