An Azure service that provides serverless Kubernetes, an integrated continuous integration and continuous delivery experience, and enterprise-grade security and governance.
Hello Jena, Tapas Kumar (893) (EXT),
Welcome to the Microsoft Q&A and thank you for posting your questions here.
What I understood in your question is application pods are running on the AKS system node pool instead of the user/agent node pool, and some workloads are also showing Tenant: None.
The issue is usually caused by missing workload scheduling constraints. In AKS, system node pools are intended for critical system pods such as CoreDNS and metrics-server, while user node pools are intended for application workloads. By design application pods can still be scheduled on a system node pool if the cluster does not restrict scheduling, but this is not recommended for production isolation. - https://learn.microsoft.com/en-us/azure/aks/use-system-pools
The best practice resolution is to:
- Keep the system node pool reserved for AKS system components.
- Use a user/agent node pool for application pods.
- Add nodeSelector or node affinity to application deployments.
- Add a taint such as
CriticalAddonsOnly=true:NoScheduleon the system node pool to prevent regular application pods from landing there. - Add labels to the user node pool and target those labels from your application manifests.
- Review the “Tenant: None” value, because AKS does not automatically assign a tenant to pods. If this is from your monitoring, security, or cost workbook, it usually means the pod/namespace is missing the expected tenant label, annotation, or workload identity mapping.
After applying labels, node selectors, and system pool taints, application pods should be recreated on the correct user/agent node pool, while AKS system pods remain on the system node pool.
Use the above and below official resources for more reading and implementation steps:
- https://learn.microsoft.com/azure/aks/use-node-taints
- https://learn.microsoft.com/azure/aks/use-labels
- https://learn.microsoft.com/azure/aks/create-node-pools [learn.microsoft.com]
I hope this is helpful. Please! Do not hesitate to let me know if you have any other questions, steps or clarifications.
Please do not close the thread by upvoting and accepting the answer if any part of it is helpful.