12 September 2024
Release date: 12 September 2024
Release Notes
Section titled “Release Notes”Features
Section titled “Features”- Initial EKS + Supporting Content Release: This release marks the initial launch of the Multi-cluster AWS EKS processing backend along with Pod Metrics for both AKS and EKS. Minimal customer impact is expected, and no customer notification is required. The planned staging date is 08/06/2024, with the production date to be determined.
Enhancements
Section titled “Enhancements”- Enable aws-us1 Region for Base User Ingestion: With the AWS EKS release to higher environments, Engine Image ingestion at the API layer is now enabled, supporting Linux, Windows 2019, and Windows 2022 Operating Systems.
- Accommodate Multiple K8s Clusters in Single Region: Updates have been made to accommodate multiple Kubernetes Clusters per region due to Custom Networking Mode in AWS EKS. This affects Deployment and Secrets SFNs, which now recognize the specific cluster to write information into based on the region and desired Operating System.
- Support Multiple K8s Clusters in Single Region for Custom Networking: The API has been updated to include additional information for workflows involving Deployment Secret CRUD, accommodating multiple Kubernetes Clusters per region due to Custom Networking Mode in AWS EKS.
- Kubernetes Pods for Billing Metrics: Work is ongoing to capture metrics associated with running Pods across all Kubernetes Nodepools, aiming to accurately allocate costs among different business areas based on actual usage and processing activities.
Research and Development
Section titled “Research and Development”- Capturing Kubernetes Pod Metrics for Billing: A comprehensive document has been produced, covering metric schema, architecture, and how to extract metrics from AWS EKS and Azure AKS into Data Hub, facilitating billing and cost allocation.
Infrastructure and Innovation
Section titled “Infrastructure and Innovation”- Infrastructure for Metrics Pipeline in Azure AKS and AWS EKS: Infrastructure has been established for a metrics pipeline in both Azure AKS and AWS EKS, enabling the capture and processing of pod-level metrics across all cloud providers and regions. This infrastructure supports the differentiation between “owner” and “executor” for billing purposes.
This release introduces significant infrastructure and feature enhancements, particularly in the realm of Kubernetes and cloud processing capabilities. It lays the groundwork for more detailed and accurate billing metrics, enhancing transparency and fairness in cost allocation across different business units.