Default evaluation flows failing

Hi #LIM YONG KANG#

Good day.

Attached Steps to Troubleshoot:

Check Runtime Status: Ensure your runtime is properly configured and ready to use. Sometimes, issues arise when the runtime isn't active or doesn't have the necessary permissions.

Validate Permissions: Make sure the roles assigned to your workspace resources (like AzureML Data Scientist, AcrPull, etc.) have the correct permissions to log metrics and write to run history.

Review Connection Setups: If you're using additional tools like LLMs in your flows, verify that your connections are correctly established.

Check for Resource Limits: Since you mentioned that you switched to a higher spec VM, also check if there are any resource usage limits or quotas that are being hit.

Look for Dependency Issues: Confirm that all required modules or libraries are available in your environment, especially if you're using custom environments.

Examine Logs for Errors: Review any error traces or failed node logs associated with your flows. These can provide insight into what's going wrong. If you have specific logs, sharing them can help diagnose the issue better.

1. Timeout Management: If your evaluation involves complex operations that may timeout, consider simplifying the request or running it in a batch mode.

Follow-Up Questions:

• Can you provide the specific error trace or failed node logs?
• Which region is your Azure ML workspace set up in?
• Have you checked the permissions for your Azure resources related to the workspace?
• Are there any additional tools or dependencies you are using in your evaluation flows?
• Have you changed or updated any configurations recently in your workflows?

By following these steps and reflecting on the follow-up questions, you should be able to narrow down the cause of the issue. You can also refer to the additional resources that may help you further:

References

1. Troubleshoot problems in flow run or bulk test
2. Submit batch run and evaluate a flow
3. Common troubleshooting issues
4. How to develop an evaluation flow

Thank you.