Azure Managed Grafana instance returns HTTP 500 "UnexpectedInternalException"

Question

Azure Managed Grafana instance returns HTTP 500 "UnexpectedInternalException"

Chanchan Liu 0 Microsoft Employee

Azure Managed Grafana instance returns HTTP 500 "UnexpectedInternalException"
  on all authenticated requests (portal + API) after a dashboard change.
  The data-plane backend is unresponsive: authenticated /api/health intermittently
  returns 500 or times out (40s+). Unauthenticated gateway responses are normal
  (401/302, ~1s). Control plane is healthy (provisioningState=Succeeded,
  ResourceHealth=Available, no ARM activity-log changes in 14 days).

  A forced data-plane reconcile (toggling apiKey Enabled->Disabled via
  'az grafana update') did NOT recover the backend, indicating a persisted-data /
  crash-loop condition tied to a recent dashboard edit.

  Please (1) restart/recover the data-plane backend, and (2) identify and remove or
  roll back the dashboard change that is crash-looping the instance.

  Resource ID: /subscriptions/2e8d4cf4-bf0b-48ba-bd16-c06ef4dcbc52/resourceGroups/3squalificationexpgate/providers/Micro
  soft.Dashboard/grafana/PPE-3SQualityGate
  Endpoint:    https://ppe-3squalitygate-cddyapbfcdc0ewbq.wus2.grafana.azure.com
  Region: westus2 | SKU: Standard | Grafana version: 11.6.9
  W3C Trace ID:        00-128254c4de3d7f23feda78eea5022c30-d68f0022e147dfc6-00
  LiftrCorrelationId:  e56ce3ad-8c38-4281-acd1-413a434508ed



The Grafana Host Url response:
	<body style="background-color: rgb(38, 52, 72); ">
    <br />
    <h1 style="font-family: verdana; text-align: center; color: white; align-content:baseline">
        <svg style="vertical-align: text-bottom; margin-right:10px" width="40" height="40" viewBox="0 0 40 40" fill="none" xmlns="http://www.w3.org/2000/svg">
  <path d="M12.3913 4.13597C12.6205 3.45707 13.2571 3 13.9736 3H24.6745L13.5831 35.8633C13.354 36.5422 12.7173 36.9992 12.0008 36.9992H3.62616C2.48366 36.9992 1.6785 35.8777 2.04385 34.7952L12.3913 4.13597Z" fill="url(#paint0_linear)" />
  <path d="M29.4453 25.0039H12.619C11.9113 25.0039 11.5701 25.8713 12.0882 26.3534L23.0468 36.5521C23.3559 36.8397 23.7624 36.9996 24.1845 36.9996H33.5992L29.4453 25.0039Z" fill="#0078D4" />
  <path d="M13.9737 3C13.2571 3 12.6205 3.45707 12.3913 4.13597L2.04386 34.7952C1.67851 35.8777 2.48367 36.9992 3.62617 36.9992H12.0008C12.7173 36.9992 13.354 36.5422 13.5831 35.8633L15.6682 29.6852L23.0469 36.5521C23.3559 36.8397 23.7624 36.9996 24.1846 36.9996H33.5993L29.4453 25.0039H17.2481L24.6745 3H13.9737Z" fill="url(#paint1_linear)" />
  <path d="M27.6071 4.13743C27.3779 3.45854 26.7413 3.00146 26.0248 3.00146H14.049H14.1035C14.8329 3.00146 15.481 3.46674 15.7142 4.15781L26.0415 34.7571C26.4134 35.8591 25.5938 37.0007 24.4308 37.0007H24.2487H36.3722C37.5148 37.0007 38.3199 35.8792 37.9546 34.7967L27.6071 4.13743Z" fill="url(#paint2_linear)" />
  <defs>
    <linearGradient id="paint0_linear" x1="13.9224" y1="4.17684" x2="2.83367" y2="36.9356" gradientUnits="userSpaceOnUse">
      <stop stop-color="#114A8B" />
      <stop offset="1" stop-color="#0669BC" />
    </linearGradient>
    <linearGradient id="paint1_linear" x1="22.7802" y1="25.1033" x2="20.2172" y2="25.9703" gradientUnits="userSpaceOnUse">
      <stop stop-opacity="0.3" />
      <stop offset="0.0711768" stop-opacity="0.2" />
      <stop offset="0.321031" stop-opacity="0.1" />
      <stop offset="0.623053" stop-opacity="0.05" />
      <stop offset="1" stop-opacity="0" />
    </linearGradient>
    <linearGradient id="paint2_linear" x1="20.9518" y1="4.17835" x2="33.1237" y2="36.6074" gradientUnits="userSpaceOnUse">
      <stop stop-color="#3CCBF4" />
      <stop offset="1" stop-color="#2892DF" />
    </linearGradient>
  </defs>
</svg>
        Internal Error
    </h1>
    <br />
    <p style="font-family: verdana; font-size: 120%; text-align: center; color: white;">
        The request has failed because of an internal error.  Trace ID: 00-2323f5a11cfcf2fceb0cdd1c0f1af34e-eb81e06a33ab257b-00
        <br />
        <br />
        <a style="font-family: verdana; text-align: center; color: white;" href="https://aka.ms/managed-grafana-docs">
            Please check the documentation for further details.
        </a>
        
    </p>
    <script>
        window.addEventListener('load', function () {
            var eventProperties = {
                W3cTraceId: '00-2323f5a11cfcf2fceb0cdd1c0f1af34e-eb81e06a33ab257b-00',
                LiftrCorrelationId: 'eb8acada-10ff-439f-91e0-56793e71390a',
                StatusCode: '500',
                ExceptionName: 'UnexpectedInternalException',
                AadObjectId: 'a0e3780f-6fac-4ece-857b-e6a243cd7363',
                AadTenantId: '72f988bf-86f1-41af-91ab-2d7cd011db47',
                GrafanaApplicationVersion: '11.6.9',
                AmgSku: 'Standard',
                AmgLocation: 'westus2',
                PageHost: window.location.host,
                PageUrl: window.location.href.split('?')[0]
            };
            // 'gra-prod-gateway-error-ai'
            var appInsightsIdentifier = 'df8b4678-60da-4381-b65c-30e179de1c6d';
            var appInsightsUrl = 'https://dc.services.visualstudio.com/v2/track';
            var payload = {
                iKey: appInsightsIdentifier,
                name: 'Microsoft.ApplicationInsights.Event',
                time: new Date().toISOString(),
                data: {
                    baseType: 'EventData',
                    baseData: {
                        name: 'amg_gateway_error_page_view',
                        properties: eventProperties
                    }
                }
            };
            // Send custom event to Application Insights
            fetch(appInsightsUrl, {
                method: 'POST',
                headers: {
                    'Content-Type': 'application/json'
                },
                body: JSON.stringify(payload)
            })
                .then(response => {
                    if (!response.ok) {
                        console.error('Failed to send event to Application Insights', response);
                    }
                })
                .catch(error => {
                    console.error('Error sending event to Application Insights', error);
                });
        });
    </script>
</body>

Siva shunmugam Nadessin 10,905 Reputation points Microsoft External Staff Moderator

2026-05-29T11:01:40.86+00:00

Hello Chanchan Liu,

Thank you for reaching out to the Microsoft Q&A forum.

We are currently investigating on the issue and will keep you posted?
Siva shunmugam Nadessin 10,905 Reputation points Microsoft External Staff Moderator

2026-05-29T11:46:38.41+00:00
Hello Chanchan Liu,

Thank you for reaching out to the Microsoft Q&A forum.

Follow-up questions to help us to investigate further:

Do you already have a copy of the dashboard JSON from before your change?

Can you share the exact dashboard “slug” or UID you updated?

Does your workspace have Diagnostics Settings turned on in Azure Monitor (so we can review any internal crash logs)?

Have you tried the ARM “forceRestart” tag update or toggled the Managed Identity? Any luck?

Would you like me to open a P1 support case now so the service team can trigger a backend recycle for you?

Let me know if any further queries - feel free to reach out!

1 answer

Your answer

Siva shunmugam Nadessin 10,905 Reputation points Microsoft External Staff Moderator

2026-05-29T11:01:40.86+00:00

Hello Chanchan Liu,

Thank you for reaching out to the Microsoft Q&A forum.

We are currently investigating on the issue and will keep you posted?
Siva shunmugam Nadessin 10,905 Reputation points Microsoft External Staff Moderator

2026-05-29T11:46:38.41+00:00

Hello Chanchan Liu,

Thank you for reaching out to the Microsoft Q&A forum.

Follow-up questions to help us to investigate further:

Do you already have a copy of the dashboard JSON from before your change?

Can you share the exact dashboard “slug” or UID you updated?

Does your workspace have Diagnostics Settings turned on in Azure Monitor (so we can review any internal crash logs)?

Have you tried the ARM “forceRestart” tag update or toggled the Managed Identity? Any luck?

Would you like me to open a P1 support case now so the service team can trigger a backend recycle for you?

Let me know if any further queries - feel free to reach out!

Answer 1

Chanchan Liu 0 Microsoft Employee

hi @Siva shunmugam Nadessin , the issue is caused by Network Infrastructure Issue. The Grafana dashboard recovered now. https://ms.portal.azure.com/#view/Microsoft_Azure_Health/DetailsPage.ReactView/fromDeeplink~/false/index~/0/selectedEventSummary~/%7B%22trackingId%22%3A%22GHRP-84G%22%2C%22scope%22%3A%22Subscription%22%2C%22impactedSubscriptions%22%3A%5B%222e8d4cf4-bf0b-48ba-bd16-c06ef4dcbc52%22%5D%7D/trackingId/GHRP-84G/impactedSubs~/%5B%222e8d4cf4-bf0b-48ba-bd16-c06ef4dcbc52%22%5D/scope/Subscription

Bharath Y P 10,610 Reputation points Microsoft External Staff Moderator

2026-06-01T03:55:37.7466667+00:00

We glad to hear your issue has been resolved. Please Feel free to reach out if you need any further assistance. Thank you.