Not able to submit the evaluation in new azure foundry. Getting 403 error

Anonymous
2026-05-18T06:48:31.7733333+00:00

I am trying to submit the dataset for evaluation in the new azure foundry. I do have all the access to submit. But still getting 403 forbidden error. What could be the issue?User's image

Foundry Agent Service
Foundry Agent Service

A fully managed platform in Microsoft Foundry for hosting, scaling, and securing AI agents built with any supported framework or model


Answer accepted by question author
Anshika Varshney 15,625 Reputation points Microsoft External Staff Moderator
2026-05-18T07:20:34.0766667+00:00

Hi Nandha,

This issue usually happens due to a small configuration or UI-related problem in Azure AI Foundry, especially in the new evaluation experience. You can try the below checks step by step.

  1. Check if all required fields are filled

Sometimes the Submit evaluation button does not work if any required field is missing.

  • Make sure dataset is selected
  • Make sure model or deployment is selected
  • If there are any evaluation metrics or configuration fields, ensure they are filled properly

Even one missing field can block submission without showing a clear error.

  1. Validate dataset format

The evaluation will only work if the dataset format is correct.

  • Ensure your dataset matches the expected schema
  • For example, prompt and response columns should be properly mapped
  • No empty rows or invalid values

If the dataset is not valid, the evaluation may fail silently.

  1. Check deployment and region

Make sure that:

  • The model deployment is active and in running state
  • The deployment region supports evaluation features

Some features in Azure AI Foundry are region dependent, so using a different supported region can help in testing.

  1. Try with a small sample dataset

To isolate the issue:

  • Create a small dataset with a few rows
  • Run evaluation again

If this works, then the issue might be related to dataset size or formatting.

  1. Browser-related checks

The new Foundry UI sometimes has temporary UI issues.

Try the following:

  • Refresh the page
  • Open in another browser
  • Use incognito or private mode
  • Clear browser cache
  1. Check for validation or console errors

Open browser developer tools and check:

  • Any validation errors
  • Any failed API calls

This can help identify if something is being blocked at UI level.

  1. Recreate evaluation configuration

If nothing works:

  • Create a new evaluation setup from scratch
  • Re-upload dataset and reselect model

Sometimes configuration gets stuck in the UI.

In short: In most cases, this issue comes down to:

  • Missing required input fields
  • Dataset format issues
  • Temporary UI glitches in the new Foundry experience

I Hope this helps. Do let me know if you have any further queries.

Thankyou!

Was this answer helpful?

1 person found this answer helpful.

1 additional answer

Sort by: Oldest
  1. Anonymous
    2026-05-18T06:56:27.9233333+00:00

    I am trying to upload the data set manually in the evaluation section and submit for evaluation. I have all the roles mentioned in the screenshot. Still getting 403. There is no storage account connected with this foundry. User's image

    Was this answer helpful?

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.